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(54) Camera controller 

(57) A camera control system for displaying a video 
image inputted from a plurality of cameras : wherein in 
order to easily control each camera, a map showing po- 
sitions of cameras is prepared. Along with the map, 
icons indicating the positions of cameras are displayed • 
on the map so that the directions of the cameras can be 
identified on the map. An operator is able to select a 
camera referring to the map and see the video image of 
the selected camera. When each of the cameras is to 
be operated, an operator uses a pointing device to op- 
erate an icon for a camera on the map. In this camera 
control system, a camera corresponding to each icon 
can be controlled for zooming, panning, tilting and fo- 
cusing by operating the icon for each camera. An oper- 
ator may delete, add or move the icon for a camera ac- 
cording to an actual structure of the camera system. 
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Description 

BACKGROUND OF THE INVENTION 



The present invention relates to a camera controller s 
and ; more particularly, to a camera controller including 
at least one video camera in which panning, tilting, 
zooming, and the like can be controlled. 

A plurality of video cameras whose panning, tilting, 
zooming, and the like can be externally controlled are io 
often equipped as monitor cameras or the like. When a 
plurality of cameras are remote-controlled by a single 
controller, a single video camera as an object to be op- 
erated is selected by a serial number, a name, or the 
like that can identify each camera, and the selected vid- '5 
eo camera is panned, tilted, zoomed, or the like by op- 
erating, e.g., up, down, right, and left buttons on an op- 
eration panel shown in Fig. 1 6 while observing an image 
picked up by the selected video camera. 

However, it is often difficult to recognize a camera 20 
to be controlled by only its name and an image. More 
specifically, it is not easy for an operator to recognize 
the relationship between an image, and the position and 
direction of a camera by observing the image. 

In such a camera symbol display system, it is desir- 25 
able that a user himself or herself can change the initial 
setting state of the system upon a change in layout of 
cameras or upon addition of a new map. It is very trou- 
blesome to ask a system manager of a network for ex- 
ecuting such a change each time a change is required. 30 
Since the camera control system must be temporarily 
stopped to change the initial setting state, and must be 
restarted after the change, other users cannot use the 
system during this interval. 

. 35 

SUMMARY OF THE INVENTION 

The present invention has been made in consider- 
ation of the above-mentioned situation, and has as a 
concern to provide a camera control system which al- 40 
lows a user to visually recognize the system state. 

It is another concern of the present invention to pro- 
vide a camera control system which allows an easy 
change of the system configuration. 

In accordance with an aspect of the present inven- 45 
tion a video controller for controlling a video input oper- 
ation, comprises: 

video input means including at least one externally 
controllable inpu : unit; so 
selection means 'or selecting one of the input units, 
and receiving an image input from the selected 
input unit: 

video display means for displaying the image input 
from the input unit selected by the selection means; $$ 
map display means for displaying a map indicating 
a target video input region of the video input means, 
and displaying, on the map, each of ine input units 



as a predetermined symbol in correspondence with 
a position of the input unit: 

operation means for operating the symbol on a dis- 
play screen: and 

control means for controlling the input unit corre- 
sponding to the operated symbol in accordance 
with an operation result of the symbol by the oper- 
ation means. 

In accordance with a second aspect of the invention 
a video control system for controlling a video input de- 
vice connected to a network, comprises: 

a client apparatus which is connected to the net- 
work, requests use of a desired video input device, 
and controls the video input device to receive an 
image when the client apparatus is connected to the 
video input device: and 

a management apparatus for managing a connec- 
tion state between the client apparatus and the 
video input device, 

wherein upon receiving a request from the client 
apparatus, the management apparatus checks if a 
predetermined condition is satisfied, and if it is 
determined that the condition is satisfied, the man- 
agement apparatus permits the client apparatus to 
use the video input device. 

According to a third aspect of the present invention 
a camera controller comprises: 

at least one externally controllable camera: 
selection means for selecting one of the cameras 
and receiving an image input from the selected 
camera; 

video display means for displaying the image input 
from the camera selected by the selection means: 
map display means for displaying a map of a region 
where the cameras are disposed, and displaying, 
on the map, each of the cameras as a predeter- 
mined symbol in correspondence with a position of 
the camera; 

operation means for operating the symbol on a dis- 
play screen: and 

control means for controlling the camera corre- 
sponding to the operated symbol in accordance 
with an operation result of the symbol. 

In accordance with a still further aspect of the in- 
vention a camera control method for controlling a re- 
mote camera, comprises: 

the display step of displaying a map, and displaying 
symbols of cameras on the map: 
the selection step of selecting a desired symbol 
from the symbols; 

the step of displaying an image input from the cam- 
era corresponding to the symbol selected in the 
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selection step: and 

the change step of changing a state including a pan 
angle of the camera selected in the selection step. 

Alternatively, the camera control method for control- 
ling a remote camera may comprise: 

the step of reading an initial setting state: 
the display step of displaying a map and displaying 
symbols of cameras on the map on the basis of the 
initial setting state: 

the operation step of performing operations includ- 
ing addition, deletion, change of position, and 
change, of direction of the symbol by operating the 
symbol using coordinate indication means: and 
the step of storing the symbol operated in the oper- 
ation step as the initial setting state. 

A camera management method according to anoth- 
er aspect of the invention for managing an access to a 
remote camera, comprises: 

the step of identifying a request destination appa- 
ratus on the basis of an access request to the cam- 
era: 

the first discrimination step of discriminating if an 
access source of the access request is permitted to 
access the camera of an access destination: 
the second discrimination step of discriminating if 
the camera corresponding to the access request is 
in use when it is determined in the first discrimina- 
tion step that the access source is permitted to 
access the camera: 

the step of making an access to the camera when 
the camera is not in use: 

the request step of issuing a change request of a 
condition for permitting an access in the first dis- 
crimination step: and 

the step of changing a table, which is looked up in 
the first discrimination step, and registers permis- 
sion or non-permission of access requests of 
access request source apparatuses in units of cam- 
eras, in correspondence with the change request. 

Alternatively, a camera management method for 
managing an access to a remote camera may comprise: 

the step of identifying a request destination appa- 
ratus on the basis of an access request to the cam- 
era; 

the discrimination step of discriminating, with refer- 
ence to a table, which registers permission or non- 
permission of access requests of access request 
source apparatuses in units of cameras, if an 
access source of the access request is permitted to 
access the camera of an access destination; 
the step of receiving a change request of the table, 
and identifying a request source of the change 



request: and 

the step of changing permission or non-permission 
of the access in the table corresponding to the 
request source of the change request in corre- 
5 spondence with the change request. 

Other features and advantages of the present in- 
vention will be apparent from the following description 
taken in conjunction with the accompanying drawings, 
10 in which like reference characters designate the same 
or similar parts throughout the figures thereof. 

BRIEF DESCRIPTION OF THE DRAWINGS 

is The accompanying drawings, which are incorporat- 
ed in and constitute a part of the specification, illustrate 
embodiments of the invention and, together with the de- 
scription, serve to explain the principles of the invention. 

20 Fig. 1 is a schematic block diagram showing the 
arrangement according to the first embodiment of 
the present invention: 

Fig. 2 is a view showing an example of a display 
screen of the first embodiment: 
25 Fig. 3 is a partial operation flow chart of the first 
embodiment: 

Fig. 4 is a partial operation flow chart of the first 
embodiment; 

Fig. 5 is a table showing an example of the contents 
30 of camera position information: 

Fig. 6 is a diagram showing an example of the 
arrangement used when the first embodiment is 
applied to a network: 

Fig. 7 is a table showing an example of the contents 
35 of camera position information used when the first 
embodiment is applied to a network: 
Fig. 8 is a partial operation flow chart of the second 
embodiment; 

Fig. 9 is partial operation flow chart of the second 

40 embodiment: 

Fig. 10 is an explanatory view of the change oper- 
ation of the pan angle and the focal point position; 
Fig. 11 is an explanatory view of the zoom ratio 
change operation in the wide-angle direction; 

45 Fig. 12 is an explanatory view of the zoom ratio 
change operation in the telephoto direction: 
Figs. 13A and 13B are explanatory view of the tilt 
angle change operation: 

Fig. 14 is a view showing a display example of a 

so map in the second embodiment: 

Fig. 15 is a flow chart showing the sequence upon 
combination of the first and second embodiments; 
Fig. 16 is a view showing an example of a conven- 
tional operation screen: 

55 Fig. 17 is a schematic block diagram showing the 
arrangement according to the third embodiment of 
the present invention: 

Fig. 18 is a block diagram showing the software 
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arrangement for executing the operation of the third 
embodiment: 

Fig. 1 9 shows a function for calling a camera control 
server 41 : 

Fig. 20 shows a function for registering/deleting a 
user: 

Fig. 21 A is a view showing a function [camerajn]: 
Fig. 21 B is a view showing a function [func_out]; 
Fig. 22 is a view showing an example of a camera 
state list: 

Fig. 23A is a flow chart showing the registration 
processing upon start of a camera: 
Fig. 23B is a flow chart showing the deletion 
processing upon stop of a camera; 
Fig. 24 shows an example of a program, i.e., a func- 
tion for performing access processing: 
Fig. 25 is a view showing an example of an access 
permission list: 

Fig. 26 is a flow chart showing the processing exe- 
cuted in response to a camera access request: 
Fig. 27 shows an example of a program, i.e. , a func- 
tion for setting access permission: 
Fig. 28 is a flow chart showing the processing for 
changing an access state: 
Fig. 29 is a view showing an example of a GUI: 
Fig. 30 is a flow chart showing the access start 
processing; 

Fig. 31 is a flow chart showing the sequence for con- 
trolling a camera: 

Fig. 32 is a flow chart showing the access end 
processing; 

Fig. 33 is a flow chart showing the sequence of a 
function [access_end_l]; 

Fig. 34 is a flow chart showing the access permis- 
sion setting processing: 

Fig. 35 is a view showing an example of a screen 
of the fourth embodiment; 

Fig. 36 is a view showing the basic arrangement of 
a camera icon: 

Fig. 37 is a table showing the structure of a camera 

information file and an example of data: 

Fig. 38 is a table showing the structure of a camera 

state table and an example of data: 

Fig. 39 is an operation flow chart of the fourth 

embodiment: 

Fig. 40 is a flow chart showing the camera icon dis- 
play processing in correspondence with camera 
control characteristics: 

Fig. 41 shows display example 1 of the camera icon: 
Fig. 42 shows display example 2 of the camera icon; 
Fig. 43 shows display example 3 of the camera icon; 
Fig. 44 is a table showing additional information 
used when the fourth embodiment is applied to a 
network: 

Fig. 45 is a schematic block diagram showing the 
schematic arrangement of a computer system 
according to the fifth embodiment of the present 
invention: 
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Fig. 46 is a schematic block diagram showing the 
hardware arrangement of the fifth embodiment in a 
network: 

Fig. 47 is a schematic block diagram showing the 
software arrangement of the fifth embodiment in the 
network; 

Fig. 48 is a table showing an example of the config- 
uration of a camera initial setting file: 
Fig. 49 is a view showing an example of a camera 
display control panel displayed on monitors 460 and 
462 by a camera control client 472: 
Fig. 50 is a view showing an example of the display 
screen of an initial setting edit software program 
474: 

Fig. 51 is an operation flow chart of the initial setting 
edit software program 474 corresponding to Fig. 50: 
Fig. 52 is a view showing another example of the 
camera display control panel; 
Fig. 53 is a table showing an example of map infor- 
mation: 

Fig. 54 is a table showing an example of camera 
initial setting information: 

Fig. 55 is a view showing another example of the 
display screen of the initial setting edit software pro- 
gram 474: 

Fig. 56 is an operation flow chart of the initial setting 
edit software program 474 corresponding to Fig. 55; 
and 

Fig. 57 is a flow chart showing the sequence for val- 
idating a system change without restarting the sys- 
tem. 



DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 



<First Embodiment 

The first embodiment of the present invention will 
be described in detail below with reference to the ac- 
companying drawings. 

Fig. 1 is a schematic block diagram showing the ar- 
rangement of a camera control system according to the 
first embodiment of the present invention. Camera con- 
trol circuits 12 (12-1 , 12-2, 12-3,...) directly control pan- 
ning, tilting, zooming, focusing, diaphragm setting, and 
the like of video cameras 10(10-1, 10-2, 10-3,...) in ac- 
cordance with external control signals. As control signal 
lines, for example, RS-232C interfaces may be used. 
However, the present invention is not limited to them. 

A camera operation unit 20 is a computer system 
for controlling the video cameras 1 0 by supplying control 
commands to the camera control circuits 12. A CPU 22 
controls the entire apparatus. A main memory 24 and a 
secondary memory 26 (e.g., a hard disk) store programs 
to be executed by the CPU 22, data, and the like. A bit- 
map display 28 displays an image such as a map (to be 
described later). A mouse 30 is a pointing device for in- 
dicating a position on the display 28. 
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A camera selector 32 selects one of the plurality of 
video cameras 1 0. The selected camera is operated un- 
der the control of the camera operation unit 20. A video 
capture device 34 captures an output video signal from 
the video camera 10 selected by the camera selector 
32. A network interface 36 connects the camera opera- 
tion unit 20 to a computer network or a communication 
network. A system bus 38 connects the respective de- 
vices (the CPU 22 to the network interface 36) to each 
other. A camera control signal can be supplied to the 
camera operation unit 20 via the network by the network 
interface 36, thus controlling the cameras 10. 

The camera selector 32 selects one of the control 
signal lines and video outputs connected to the plurality 
of camera control circuits 12 : supplies the selected vid- 
eo output to the video capture device 34, and logically 
connects the selected control signal line to the bus 38. 
As the format of a video signal, for example, an NTSC 
signal of the luminance color difference separation 
method is known. The video capture device 34 captures 
the video output selected by the camera selector 32. 
The captured video signal is displayed as a motion im- 
age on a predetermined window of the bit-map display 
28. 

The secondary memory 26 stores map data indicat- 
ing the layout diagram of the cameras 10, camera posi- 
tion information data indicating the position information 
of each camera 10, icon (camera icon) data for specify- 
ing each camera 10 : and the like. 

Fig. 2 shows an example of the display screen on 
the bit-map display 28. Assume that a multi-window sys- 
tem capable of simultaneously displaying a plurality of 
windows is running on the bit-map display 28. A map of, 
e.g., an office layout is displayed on a map window 40, 
and camera icons 42-1 to 42-7 indicating the positions 
of the plurality of cameras disposed in the office are dis- 
played on the map. The camera icons 42-1 to 42-7 are 
displayed to have directions substantially the same as 
those of the cameras 10-1 to 10-7 corresponding to the 
icons. An image output from the camera 10 selected by 
the camera selector 32 are displayed on an image win- 
dow 44. In order to identify the selected camera 10 on 
the map window 40. the camera icon corresponding to 
the selected camera is displayed in a color different from 
those of the camera icons corresponding to non-select- 
ed cameras. In Fig. 2. the camera 10-1 is selected, and 
the camera icon 42-1 corresponding to this camera is 
displayed in a color different from those of other camera 
icons. 

The serial ID (identifier) number, position pan an- 
gle, tilt angle, and zoom ratio of the camera to be con- 
trolled are displayed on acamera control window 46. In 
the column of the position, the position of the camera 
corresponding to the input of the column of the camera 
number is displayed. Data can be input to columns other 
than that of the position. In Fig. 2, the selected camera 
has camera number 1 , and its position is expressed by 
(100, 20). The pan angle is 10° : the tilt angle is 5° and 



the zoom ratio is two. These angles have values based 
on the setting direction when the camera is set. 

In this embodiment, four functions, i.e., panning, tilt- 
ing, zooming, and focusing can be controlled for each 
5 camera 10. In this embodiment, the following three 
modes are provided. That is, 

Mode #1 : change pan angle and focal point 
Mode #2: change zoom ratio 
w Mode #3: change tilt angle 

As will be described in detail later when the camera icon 
of the selected camera is double-clicked, the above- 
mentioned three modes are cyclically selected. 

is If the position (central point) of the selected camera 
icon is assumed to be a point C (cx, cy), and the position 
(designated point) of a mouse cursor is assumed to be 
a point M (mx, my), the direction of a vector C -» M is 
defined as the horizontal (panning) direction of the cam- 

20 era. Note that the direction of the camera is defined by 
the direction pointed by the center of its lens, and is ex- 
pressed by the horizontal angle (pan direction) and the 
vertical angle (tilt direction) with respect to the above- 
mentioned reference fine. 

25 Note that the coordinate position on the map is ex- 
pressed by an X-Y coordinate system defined on the 
map. 

On the other hand, let L be the distance between 
the points C and M. In addition, when the pan direction 

30 of the camera is defined as a positive direction of an x- 
axis, and an axis perpendicular thereto is defined as a 
y-axis, the front side of the camera icon, i.e., a region 
satisfying x > 0 is defined as a positive direction, and an 
opposite region, i.e., a region satisfying x < 0 as the side 

35 behind the camera icon is defined as a negative direc- 
tion. Under these conditions, the sign of the designated 
position for the camera icon is defined. That is, opera- 
tions are defined as follows in correspondence with' the 
designated position, M: 

40 

Mode #1 : change designated position M to focal 
point position (in-focus point) 
Mode #2: change zoom ratio to (L x constant) 
Mode #3: change tilt angle to (L x constant x sign 
is of designated position with respect to camera icon) 

Using the parameters defined by the camera position C 
and the designated position M, the selected camera is 
actually controlled. Note that the pan angle falls within 

50 the range from -90° to +90° to have the central angle of 
0°, and the tilt angle falls within the range from -70° to 
+70° to have an angle corresponding to the horizontal 
state as 0°, an angle in the upward direction as a positive 
angle, and an angle in the downward direction as a neg- 

55 ative angle. In the operation of mode #3, the tilt angle is 
changed upward when the designated point M is located 
in front of the camera: the tilt angle is changed down- 
ward when the designated point M is located behind the 
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camera. 

The selected camera icon is displayed in different 
colors depending on the selected mode so as to allow 
easy recognition of a selected one of the three modes. 
More specifically, the icon is displayed in green in mode s 
#1 : blue in mode #2: and yellow in mode #3. 

As camera operation commands ; in this embodi- 
ment, tilt(e), pan(0) ; zoom(z), and focus(F) are used. H 
indicates the pan angle, o indicates the tilt angle, z in- 
dicates the zoom ratio, and F indicates the focal point io 
position. As a switch command of a camera to be con- 
trolled, change(n) is used, n is the camera number. The 
CPU 22 supplies these commands to the camera selec- 
tor 32 as needed, and the camera selector 32 supplies 
the above-mentioned control commands supplied from is 
the CPU 22 and associated with panning, tilting, zoom- 
ing, and focusing to the camera control circuit 12-n and 
the camera 10-n, which were selected by the command 
change(n) previously or immediately before this opera- 
tion. The camera selector 32 also transfers a video sig- 20 
nal output from the selected camera 1 0 to the video cap- 
ture device 34. 

Figs. 3 and 4 are flow charts of this embodiment as 
a whole. The operation of this embodiment will be de- 
scribed below with reference to Figs. 3 and 4. These 25 
flow charts are realized when the CPU 22 executes the 
program stored in the main memory 24. 

First, map data stored as, e.g., a file in the second- 
ary memory 26 is read, and is displayed as a bit-map 
image of an office layout in the map window 40, as ex- 30 
emplified in Fig. 2 (step S1 ). Then, a file (position infor- 
mation file) having position information indicating the ac- 
tual positions of the cameras is read (step S2). and the 
camera icons 42-1 to 42 -7 are drawn at the correspond- 
ing positions on the map window 40 on the basis of the 35 
position information (step S3). This position information 
file stores the camera numbers, camera coordinate po- 
sitions, and pointing directions (the camera directions 
when the camera pan angle = 0°) of all the cameras to 
be disposed. The pointing direction is the direction of 40 
the above-mentioned reference line. In this embodi- 
ment, assume that all the cameras are set in an initial 
state (tilt angle = 0°, focal point position = infinity, and 
zoom ratio = 1 .0) immediately after the system is start- 
ed 45 

The control waits for a mouse operation (event) of 
a user (step S4). If one of the camera icons 42-1 to 42-7 
is selected by clicking the mouse (Yes in step S5), the 
color of the clicked camera icon is changed to one indi- 
cating a selected state (in this case, red), and the red so 
icon is displayed on the map window 40 (step S6). The 
camera number n corresponding to the camera position 
is obtained from the position information file, and a cam- 
era switch command change(n) is supplied to the cam- 
era selector 32. Thus, the object to be controlled is ss 
switched to camera #n ; and an image output from cam- 
era #n is displayed on the image window 44 (step S7). 
Every time the mouse is double-clicked on the se- 



lected camera icon in a state wherein one of the cam- 
eras is selected (Yes in step S8), the mode is cyclically 
switched like #1 -> #2 -> #3 -> #1 #2 #3 In 
this process, the color of the selected icon is changed 
in correspondence with the mode (step S9 to S1 1 ). More 
specifically, the icon is displayed in green in mode #1: 
blue in mode #2; and yellow in mode #3. 

Similarly, if the mouse is dragged (to move the 
mouse with the mouse button held down) in a predeter- 
mined pattern while one of the cameras is selected (step 
S12). processing corresponding to the current mode is 
executed as follows. More specifically, the position (cor- 
responding to the center of movement of a panpod) of 
the selected camera icon is assumed to be a point C 
(cx, cy), and the position of the mouse which is being 
dragged is assumed to be a point M (mx, my). 

First, a pan angle is calculated (step S13). If mx > 
cx, the angle B (deg.) of the vector C -> M is. 

e = arctan((my - cy)/(mx - cx)) 
if mx < cx, the angle B is; 

B = arctan((my - cy)/(mx - cx)) + 180 
Therefore, a value 91 obtained by subtracting efrom the 
value of the camera pointing direction shown in Fig. 5 
corresponds to the pan angle. I n this case, since the pan 
angle falls within the range from -90° to 90° in this em- 
bodiment, if the calculated angle exceeds this range, the 
upper or lower limit value, i.e., 90° or -90° is set. 

The direction of the camera icon to be drawn is 
changed in correspondence with the calculated pan an- 
gle (step S14), and a camera angle change command 
pan(B1 ) is supplied to the control circuit 1 2-n of camera 
#n via the camera selector 32, thus panning camera #n 
of interest in the corresponding direction (S15). 

The distance L between the points C and M is cal- 
culated (step S16), and processing in units of modes is 
executed in correspondence with the distance L as fol- 
lows (step S17to S23). 

More specifically, if mode #1 is selected (#1 in step 
S1 7), the distance L is determined as a new camera fo- 
cal point position F and a mark indicating the focal point 
position is drawn at the designated point M on the map 
window 40 (step S18). In addition, a camera focal point 
change command focus (F) is supplied to the camera 
selector 32 (step S19). 

If mode #2 is selected (#2 in step S17), the zoom 
ratio z is determined based on the distance L, and the 
determined zoom ratio z is displayed as, e.g., a charac- 
ter string on the map or the camera control window 46 
(step S20). In addition, a zoom ratio change command 
zoom(z) is supplied to the corresponding camera control 
circuit 12 via the camera selector 32 (step S21). Note 
that z is set to be a value obtained by multiplying the 
distance L with a given constant. 

If mode #3 is selected (#3 in step S1 7), the camera 
vertical angle (tilt angle) 0 is determined based on the 
distance L, and the tilt angle is displayed as, e.g. , a char- 
acter string on the map or the camera control window 
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46 (step S22). In addition, a tilt angle change command 
tilt(o) is supplied to the corresponding camera control 
circuit 12 via the camera selector 32 (step S23). Note 
that o is given by arctan(L x constant x (sign of desig- 
nated position with respect to camera icon)). 

The parameters calculated in steps S18, S20, and 
S22 are forcibly changed to fall within the setting ranges 
even when the calculation result exceeds the setting 
range. 

Upon completion of the above-mentioned process- 
ing in steps S5 to S23, the flow returns to step S4 to wait 
for generation of the next event. 

In this embodiment as described above., since one 
of the camera icons disposed on the map displayed on 
the display is selected and operated, the relationship be- 
tween the actual position and direction of the camera 
and an image can be easily recognized, and the plurality 
of cameras disposed in, e.g., an actual office can be re- 
mote-controlled by a user interface that is easy to oper- 
ate. 

The embodiment shown in Fig. 1 can be applied to 
a network. For example, as shown in Fig. 6, a plurality 
of camera operation apparatuses 50-1 to 50-n each hav- 
ing the same arrangement as that of the camera control 
system shown in Fig. 1 are connected to a network 52. 
As the network 52, a local area network (LAN) or a wide 
area network (WAN) which has a bandwidth large 
enough to transmit digital motion image data captured 
by the video capture device 34 and camera control sig- 
nals is assumed. However, the present invention is not 
limited to these networks. 

Each of the camera operation apparatuses 50-1 to 
50-n can output video data captured by the video cap- 
ture device as a packet to the network 52, and can re- 
ceive a video data packet from the network 52. The bit- 
map display in each apparatus displays video data cap- 
tured by the video capture device and video data re- 
ceived from the network on the video window Each of 
the camera operation apparatuses 50-1 to 50-n can 
transmit/receive camera operation commands titt(0), 
pan(o), zoom(z), and focus(F), and a camera switch 
command change(n) onto/from the network 52. The 
camera operation commands and the camera switch 
command received from the network 52 are processed 
in the same manner as those generated in each appa- 
ratus. Such a technique is known to those who are 
skilled in the art. 

Note that the camera information additionally in- 
cludes an item of apparatus addresses uniquely as- 
signed in units of camera operation apparatuses and an 
item of map names (i.e., office names) in correspond- 
ence with the network, as shown in Fig. 7, in place of 
the information shown in Fig. 5. Upon selection of a cam- 
era, the apparatus address and/or the map name must 
be selected using, e.g., a menu to switch the camera 
operation apparatus and/or the map. Note that the item 
of map names is effective not only for the network but 
also for a case wherein cameras are disposed at remote 



places, and cannot be drawn on a single map. In this 
case, a plurality of maps can be selectively displayed 
on the map window 40. 

When the camera to be controlled is selected, and 

s its camera number is detected, the table shown in Fig. 
7 is looked up to obtain the apparatus address based 
on the camera number. When the selected camera can- 
not be directly controlled, i.e. , must be controlled via the 
network, the camera operation commands and the cam- 

w era switch command are issued via the network. In the 
camera image display operation, if the camera opera- 
tion apparatus at which a camera operation input is per- 
formed is represented by A, and the camera operation 
apparatus to which the selected camera is connected is 

is represented by B, when the map is displayed and the 
camera is selected, the apparatus A requests the appa- 
ratus B to transmit a camera image, and video data cap- 
tured by the apparatus B is transmitted to the apparatus 
A via the network. 

20 As described above, when this embodiment is ap- 
plied to a network, even when the number of inputs of 
the camera input selector is limited, a larger number of 
cameras can be controlled One or a plurality of cameras 
at remote places can be easily bidirectionally controlled. 

25 

<Second Embodiment 

An embodiment which improves the operability of 
the camera control system shown in Fig. 1 will be de- 

30 scribed below. This embodiment realizes a camera op- 
eration on the map window 40 by means of a graphical 
user interface. Figs. 8 and 9 are operation flow charts 
as a whole which are executed in response to an oper- 
ation by an operator. 

35 This embodiment has no camera operation modes, 
and the focal point, pan angle, tilt angle, and zoom ratio 
are adjusted by operating the camera and its auxiliary 
line on the map using the mouse. Although the map to 
be displayed is the same as that shown in Fig. 2, the 

40 selected camera is displayed, as shown in Fig. 14. Re- 
ferring to Fig. 14, a pan direction line (central line) 153, 
zoom lines 1 52, a tilt line 1 55, and a focal point symbol 
154 are displayed together with the camera icon 42-6. 
In the operation, map data stored in the secondary 

45 memory 26 is read, and is displayed as a bit-map image 
of an office layout, as exemplified in the map window 40 
(step S31 ). Then, a position information file is read (step 
S32), and the camera icons 42-1 to 42-7 are drawn at 
the corresponding positions on the map window 40 on 

50 the basts of the position information (step S33). 

The control waits for a mouse operation by the user 
(step S34). If one of the camera icons 42-1 to 42-7 is 
selected by double-clicking the mouse (Yes in step S35), 
the display state of the double-clicked camera icon is 

55 changed to the selected state (step S36). The camera 
number n corresponding to the camera position is ob- 
tained from the position information file, and a camera 
switch command change(n) is supplied to the camera 
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selector 32. With this operation, the object to be control- 
led to switched to camera #n. and an image output form 
camera #n is displayed on the image window 44 (step 
S37). 

If the generated event is a dragging operation of the 5 
focal point position (Yes in step S38), steps S39 to S43 
are executed. Fig. 10 is a view for explaining the oper- 
ation method for changing the pan angle and the focal 
point position. A point C indicates the center of rotation 
upon changing of the pan angle of the camera, and a m> 
point M indicates the pointer position designated by the 
mouse. Note that the "central line" is a line indicating the 
camera direction before the camera is operated : and is 
illustrated in Figs. 10 to 13Bforthe sake of convenience, 
but is not displayed on the map window 40. As for the '5 
pan angle, the camera direction is calculated based on 
a vector C -» M by the same method that has been de- 
scribed above with reference to Figs. 3 and 4 (step S39). 
When the pan angle exceeds its movable range, it is 
replaced by a value at the corresponding movable end. 20 
as in the above embodiment. The focal length is calcu- 
lated based on the scale of the map data and parame- 
ters of a lens so that the position of the point M matches* 
the focal point position (step S40). After the camera di- 
rection and the focal point position are obtained, the 25 
camera icon is re -drawn to indicate the panned camera 
direction, and a line segment is drawn between the point 
M indicating the focal point position and the point C to 
indicate that the point M is the focal point position and 
the camera direction is the direction of C -> M (steps 30 
S41 , S42). A pan command and a focal point position 
moving command are issued to the camera to be con- 
trolled via the camera control circuit so as to pan the 
camera in the designated direction, and to change the 
focal point position to the designated position (step 35 
S43). In order to indicate the camera direction using a 
camera icon, a portion indicating the direction of a lens 
is added to the camera icon, and the camera icon can 
be displayed, so that the lens portion points the desig- 
nated direction. 40 

If the generated event is a dragging operation of the 
zoom line (Yes in step S44), steps S45 and S46 are ex- 
ecuted. Figs. 11 and 12 are views for explaining the 
zoom ratio change operation. Fig. 11 shows a zooming 
operation toward the wide-angle side, and Fig. 1 2 shows 45 
a zooming operation toward the telephoto side. When 
one of the zoom lines indicating the outer edges of the 
current field range is dragged inwardly or outwardly, a 
change operation of the zoom ratio can be instructed. 
For example, in the zooming operation toward the wide- 50 
angle side, the mouse button is clicked at an appropriate 
point A on the zoom line indicated by a solid tine in Fig. 
11, and the mouse is dragged outwardly while holding 
down the mouse button. When a desired angle is ob- 
tained (point A' in Fig. 11 ), the mouse button is released. 55 
The CPU draws a half line having the point C as the start 
point and passing the point A' as a new zoom line, and 
at the same time, draws a similar half line at a position 
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symmetrical about the central line. The zoom ratio is cal- 
culated, so that angle $ formed between the central line 
and the zoom line corresponds to the horizontal dis- 
tance of the photographing field of the camera to be con- 
trolled (step S45). The calculated zoom ratio is input to 
the camera control circuit connected to the camera to 
be controlled via the camera input selector (step S46). 

Similarly, when an appropriate point A on the zoom 
line is dragged inwardly (in a direction T), as shown in 
Fig. 12, the zoom ratio is changed in the telephoto di- 
rection. 

If the generated event is a dragging operation of the 
tilt line (Yes in step S47), steps S48 and S49 are exe- 
cuted. Figs. 1 3A and 1 3B show two examples of the tilt 
angle changing operation. The tilt angle can also be 
changed in the map (i.e., on the horizontal plane). In this 
embodiment, the tilt line is drawn between the two zoom 
lines, as a line segment perpendicular to the central line 
(photographing optical axis). More specifically, an isos- 
celes triangle is formed by the two zoom lines having 
the point C as the start point and the line segment per- 
pendicular to the central line, and the base of this isos- 
celes triangle is defined as the tilt line. When an arbitrary 
point (e.g., a point A) on the tilt line is dragged in a di- 
rection to approach or to separate from the camera icon, 
the tilt angle is changed. In this embodiment, when the 
point A is dragged in a direction F in Fig. 13A or 13B, 
the tilt angle is changed upward: when the point A is 
dragged in a direction f, the tilt angle is changed down- 
ward. If the distance between the points C and A is rep- 
Tesented by L, the tilt angle o can be calculated by the 
following equation (S48): 

o = arctan((L-a)/b) 
where a and b are constants, and especially a indicates 
the position of the tilt line, which serves as a reference 
point above or below which the tilt angle is positive or 
negative with respect to the horizontal angle. When the 
angle o calculated by the above equation exceeds the 
movable range of the tilt angle, it is replaced by a value 
at the corresponding end, as in the pan angle. When the 
calculated tilt angle o is supplied to the camera control 
circuit and the camera to be controlled, the camera is 
tilted through the angle o (step S49). In this embodi- 
ment, the interior of the isosceles triangle formed by the 
two zoom line and the tilt line is displayed in a different 
color. Thus, the tilt angle can be displayed in an easy- 
to-see manner. 

With this arrangement, the operation contents, i.e., 
panning, tilting, zooming, or focusing, of the camera can 
be visually recognized. 

Upon selection of a camera on the map window by 
clicking the mouse, one, closest to the click position of 
the mouse, of the plurality of cameras on the map win- 
dow may be selected, and the dragging operation of the 
focal point position may be immediately started. With 
this control, upon clicking the mouse, the closest cam- 
era on the map is directed to the clicked point, and at 
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the same time, the focal point position is controlled to 
match the clicked point. More specifically, since the 
camera selection and the panning operation can be si- 
multaneously attained, the camera closest to the point 
of interest can be immediately directed to the point of 
interest. 

Fig. 15 shows this sequence. The same reference 
numerals in Fig. 15 denote the same processing steps 
as those in Fig. 8. 

Even when a camera is selected by double-clicking, 
the pan angle is displayed on the camera control window 
46 after the calculations of the focal length and the pan 
angle (step S163), and the map shown in Fig. 14 is re- 
displayed in correspondence with the new focal length 
and pan angle (step S164). Thereafter the camera to 
be controlled is operated (step S165) to display a new 
camera image (step S166). 

The above-mentioned embodiments may be com- 
bined or may be selectively utilized. 

As can be easily understood from the above de- 
scription, according to the camera control system of this 
embodiment, since the layout of cameras and their po- 
sitions are image-displayed using the map and camera 
icons, a visual user interface which can be easily oper- 
ated can be provided. When an arbitrary one of the plu- 
rality of cameras is selected and operated, the operabil- 
ity can be greatly improved. 

<Third Embodiment 

A video control system according to the third em- 
bodiment of the present invention will be described in 
detail below with reference to the accompanying draw- 
ings. This third embodiment suggests the video control 
system described in the above first and second embod- 
iment. The system in the third embodiment is operated 
with a software shown in Fig. 18. Note that the relation 
between the system described in the first and second 
embodiment and the system described in this third em- 
bodiment will be comprehended from the fifth embodi- 
ment. 

Fig. 17 is a schematic block diagram showing the 
arrangement of a camera controller in the video control 
system according to the third embodiment of the present 
invention. A camera device 210 has a camera unit 212 
which can photograph an object and can execute a 
zooming operation, and a panpod 214 which can control 
the posture of the camera unit 212 in the pan direction 
(right-and-left direction in Fig. 1 7) and in the tilt direction 
(up-and-down direction in Fig. 1 7). A display device 216 
can display an image picked up by the camera unit 21 2 
on its screen 216a. A workstation 220 comprises a CPU 
221 , a memory unit 222 including a ROM and a RAM 
(neither are shown), I/O ports 224 and 229 as input/out- 
put units, and a video board 225 so as to issue com- 
mands for controlling the state (e.g., the positions in the 
pan and tilt directions and the position in the zoom di- 
rection) of the camera device 210, and to display image 



information picked up by the camera device 210 on the 
display device 21 6 as display means. Also, the worksta- 
tion 220 is connected with a mouse 226 as a pointing 
device, and a keyboard 227 so as to input data. These 
5 elements are connected via a bus 228. The CPU 221 
as a system control unit controls the system. On the oth- 
er hand, the ROM in the memory unit 222 stores a pro- 
gram for executing system control, and the RAM stores 
various data. The I/O port 224 outputs state control sig- 
io nals of the camera generated by the CPU 221 to the 
camera device 210, and receives values indicating the 
respective states of the camera device 210 from the 
camera device 210. In this embodiment, the I/O port 224 
is connected to the camera device 210 via an RS-232C 
15 port. The video board 225 transmits image information 
obtained from the camera device 210 to the display de- 
vice 216. In this embodiment, a signal to be output is 
converted from the NTSC format into the RGB format. 
A plurality of camera controllers 202 as described 
20 above can be connected via a network 230, and trans- 
mit/receive signals via their I/O ports 229. With this ar- 
rangement, a so-called video meeting can be realized. 
In this embodiment, workstations are utilized as control- 
lers in consideration of versatility and processing per- 
25 formance. Alternatively personal computers may be 
used, or special-purpose controllers may be used. In 
such a video meeting system, since a user may partic- 
ipate in the meeting only as an observer, a camera con- 
troller 202' to which no camera device 210 is connected 
30 may be connected to the network 230. 

Fig. 18 is a block diagram showing the software ar- 
rangement for realizing the system of this embodiment. 
The software arrangement includes the following pro- 
grams. The workstation 220 (strictly speaking, the mem- 
35 ory unit 222) connected to the camera device 210 stores 
a video meeting program 240 as a program for transmit- 
ting image information obtained by the camera device 
210 to another location such as a remote location, and 
a camera control server 241 as a program for performing 
40 camera control. The camera control server 241 registers 
data indicating that the camera device 21 0 is connected 
to the video meeting system (network) in a camera man- 
agement server 245 (to be described later) upon starting 
of the camera device 210. Therefore, in this embodi- 
45 ment, the camera management server 245 can be con- 
sidered as registration means. 

On the other hand, the workstation 220 (strictly 
speaking, the memory unit 222) to which the display de- 
vice 216 is connected stores a video meeting program 
50 242 as a program for displaying received image infor- 
mation, and a camera control panel 243 as a program 
for remote -con trolling the camera. The camera control 
panel 243 allows to look up, describe, or correct the con- 
tents of an access permission list (to be described in 
55 detail later) managed by the camera management serv- 
er 245. Therefore, in this embodiment, the camera con- 
trol panel 243 can be considered as a portion of setting 
means. When the camera management server 245 per- 
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mits connection to the camera device 210, the camera 
control panel 243 transmits camera control signals to 
the camera control server 241 without going through the 
camera management server 245. 

Note that a combination of the above-mentioned s 
programs 241 and 243 will be referred to as a "camera 
control client" hereinafter. 

Furthermore, the camera management server 245 
is prepared as a program for managing accesses to all 
the camera devices 210. The camera management w 
server 245 need only be connected to at least one work- 
station 220 connected to.the system. Note that the cam- 
era management server 245 may be stored in all the 
workstations 220 : and one of the workstations 220 may 
serve as the server upon starting of the video meeting is 
system on the network. In the above description, the 
workstations 220 are respectively connected to the 
camera device 210 and the display device 216. Howev- 
er, since each user normally uses the camera device 
210 and the display device 216, the camera device 210 20 
and the display device 216 are connected to one work- 
station 220, as shown in the block diagram of Fig. 17. 
Therefore, the video meeting programs 240 and 242 
serve as a single program. 

Subsequently, remote control of the camera device 25 
210 by the camera control server 241, user manage- 
ment by the camera management server 245, and ac- 
cess management by the camera management server 
245 as principal operations in the arrangement of this 
embodiment will be explained below. 30 



<Remote Control of Camera> 

Implementation means which allows a given work- 
station 220 connected to the network 230 to remote- 35 
control a camera device 21 0 connected to another work- 
station 220 will be described below. 

Since the camera device 210 can be controlled by 
transmitting control signals from the workstation 220 
which stores the camera control server 241 to the cam- 40 
era device 210 via the RS-232C port, a method of out- 
putting a command string corresponding to camera con- 
trol operations to an RS-232C port (not shown) of the 
panpod 21 4 by remote-starting camera control functions 
such as panning, tilting, zooming, and the like present 45 
on the camera control server 241 using a "Remote Pro- 
cedure Call" (RPC) need only be realized. Of the control 
signals (command string), signals associated with the 
operation of the panpod 214 such as panning, tilting, 
and the U'y.e are transmitted to a control section (not so 
shown) of the panpod 214, and signals associated with 
the operation of the camera unit 212 such as zooming 
are transmitted to a control section (not shown) of the 
camera unit 212. 

A function shown in Fig. 1 9 is prepared as a function ss 
of calling the camera control server 241 at a remote 
place from the camera control client using the RPC. In 
the following description of this function, commands and 



the like shown in Fig. 1 9 are described in and "]"■ The 
following description is based on C language adopted 
in this embodiment, but other languages may be used. 
In the function shown in Fig. 19, [struct camerajn <"*> 
camerajn] is a statement of a data type for setting a set 
[camerajn] of parameters to be delivered from the cam- 
era control panel 243 to the camera control server 241 
so as to operate the camera device 210. In this case, 
the set includes real numbers [tilt_angle] and 
[pan_angle], and an integer "zoom". On the other hand, 
[struct func_out <**> f U nc_out] is a statement of a data 
type [func^out] for setting an output value. For example, 
when the processing result of the function has no prob- 
lem, ret = 0 can be set; when the processing result has 
a problem, ret = -1 can be set. Furthermore, 
[camera_open] is a function for creating a client handler 
[CLIENT *cl] required for a communication with the cam- 
era control server 241. As a result of execution of this 
function, connection between the workstation which in- 
structed execution and the camera control server is es- 
tablished. A client handler for using the server thereafter 
is created, and its address is returned. Similarly 
[camera_closeJ is a function for deleting the client han- 
dler. 

The camera control client acquires an access per- 
mission to the camera. Thereafter, the camera control 
client calls the function [camera_open] to connect a 
communication with the camera control server 241 , and 
then executes the functions such as 
[camera_pan_pos_J], and the like. Finally, the camera 
control client calls the function [camera__close] to end 
the camera control. 

For example, when the camera control client calls, 
for example, the function [camera_pan_pos_1], the val- 
ue of the [func__out] type is returned as the processing 
result. By testing this value, the execution result can be 
discriminated. Figs. 21 A and 21 B are views of the data 
types defined by Figs. 1 9 and 20. 

User management by the camera management 
server 245 will be described below. 

The camera management server 245 uses a cam- 
era state list 250 shown in Fig. 22 to attain user man- 
agement. The camera state list 250 stores the host 
names registered in the camera control server 241, i.e., 
the names indicating the camera devices 210 connect- 
ed to the network 230, and the use states of the camera 
devices 210 (ready, or being accessed by another user), 
and also stores the positions (x, y, z) of the camera de- 
vices 210 and their posture data (pan and tilt angles). 
As will be described in this embodiment, the host name 
can be the user name when only one camera device 210 
is connected to one camera controller 202, but should 
not be the same as the user name when a plurality of 
camera devices 210 are connected to one camera con- 
troller 202. In an example shown in this list 250, four 
camera devices 210 indicated by hostl, host2, host3, 
and host4 are connected, the camera device 210 of 
host2 can be controlled by the user of host3, and the 
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camera device 210 of host4 can be controlled by the 
user of hostl. The camera devices 210 of hostl and 
host3 are not operated by any users. 

Upon registration/deletion of a user, processing for 
informing the name of a user who started the camera 
control server 241 to the camera management server 
245 and registering the user name in the camera state 
list 250 upon starling of the camera control server 241 , 
and processing for deleting the user name from the cam- 
era state list 250 upon stopping of the camera control 
server 241 are realized using a function shown in Fig. 
20 that uses the RPC. In the function shown in Fig. 20 ; 
[struct host_name ••• host_name] is a statement of a 
data type [host__name] for setting parameters to be de- 
livered from the camera control panel 243 to the camera 
control server 241 so as to set the host name, and the 
number of characters of the name to be set is defined 
by [MAXNAME]. On the other hand. 
[append_camera_list_1] is the function started by the 
camera control server 241 1 and is executed in the cam- 
era management server 245. When this function is ex- 
ecuted, i.e. t when the camera control server 241 is start- 
ed (step P1), as shown in Fig. 23A, the camera man- 
agement server 245 registers the host name in the cam- 
era state list 250 (step P2). As can be seen from Fig. 
20, the host name is defined by a host_name type, and 
is indicated by [host_name -> name]. Thereafter data 
indicating that the corresponding camera device 210 
can be controlled via the camera control server 241 is 
stored. When the camera control server 241 is stopped, 
as shown in Fig. 23B, another program calls a function 
for starting [delete_hostJist_1] in the camera control 
server 241 (step PP1 ), and thereafter the camera con- 
trol server 241 deletes the host name, thus ending ex- 
ecution of the process (step PP2). Therefore : in this em- 
bodiment, the camera management server 245 can also 
be considered as setting means. <Access Manage- 
ment 

Access management by the camera management 
server 245 will be described below. In order to perform 
the above-mentioned camera control and the like, an ac- 
cess permission to the camera must be acquired. This 
processing is performed by the camera management 
server 245. 

As the sequence for access management by the 
camera management server 245, functions 
[access_begin_1] and [access_end_1] started by the 
camera control client and executed by the camera man- 
agement server 245 are used (see Fig. 24). These func- 
tions can execute the start and end of an access. Note 
that [struct access_in ••• access_in] is a statement of 
parameters to be delivered from the camera control pan- 
el 243 to the camera management server 245 so as to 
set an access target. More specifically, a partner to be 
accessed is set by [target_name] whose maximum val- 
ue is defined by [MAXNAME], and a user (own) is set 
by [user_name]. 

The sequence of the access request processing will 



be described below. Prior to the description, an access 
permission list 260 will be explained with reference to 
Fig. 25. The access permission list 260 (261 ) is held by 
the camera management server 245, and has lists 261 
5 of users who can access the camera device 210 regis- 
tered in the list 260 in units of camera devices 210. Fig. 
25 exemplifies the list 261 for the camera device 210 
indicated by host2. In this list, accesses from users in- 
dicated by hostl and host4 are permitted, and an access 
w from a user indicated by host3 is not permitted. Note 
that the user of host2 does not participate in this list 261 
since he or she can control the camera device 210 indi- 
cated by host2 without going through the camera man- 
agement server 2. The usage status of the camera de- 
15 vice 21 0 by the user of host2 is managed by the camera 
management server 2. This access permission list can 
be changed, as will be described later. 

The access request processing executed by the 
function [access_begin_1] is executed in accordance 
20 with the flow chart shown in Fig. 26. 

When the camera control client issues an access 
request to the camera device 210, the camera device 
name whose access is requested by the camera control 
client is decoded from the parameter [target_name] in 
25 the function [access_begin_1] (step S261). 

It is then checked with reference to the camera state 
list 250 if the camera device 210 of interest is started, i. 
e. : if there is a user who is using the camera control serv- 
er of the camera device of interest (step S262). If NO in 
30 step S262, the flow advances to step S267. 

On the other hand, if YES in step S262, the param- 
eter [user_name] in the function [access_begin_1 ] is de- 
coded, and it is confirmed with reference to the access 
permission list 261 if the user indicated by this name has 
35 a right of accessing the camera device 210 indicated by 
[target_name] (step S263). If NO in step S263, the flow 
advances to step S267. 

On the other hand, if YES in step S263, it is con- 
firmed with reference to the camera state list 250 if the 
•to camera device of interest is unused by another user 
(step S264). If NO in step S264, the flow advances to 
step S267. 

On the other hand, if YES in step S264, the user 
name (host name) is registered in the camera state list 

45 250 (step S265), and it is determined that the access 
request is successful (step S266). Thereafter the flow 
returns to the main routine. 

In step S267, it is determined that an access is not 
successful, and the flow returns to the main routine. 

so The access result is returned to the client who is- 
sued the access request. 

The camera control client side must execute the 
functions [access_begin_1 ] and [access_end_1] before 
and after an access operation. 

55 Furthermore^ in order to implement means for set- 
ting a permission of the right of access in units of users 
by a user himself or herself, a function 
[change_access_mode_1 ] with which the user changes 
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the access permission lists 260 and 261 in the camera 
management server 245 is prepared. This function will 
be described below with reference to Fig. 27. This func- 
tion is also executed by the camera management server 
245. 5 

The camera control client sets the host name, 
whose access permission is changed, in [target_name], 
and the changed access state in [accessjnode] as var- 
iables of a [struct changejn changejn] type, and 
requests the camera management server 245 to exe- w 
cute [change_access_mode_1]. The camera manage- 
ment server 245 executes a command [gethost] as a 
library function of the UNIX to confirm the user (i.e. host 
name to say precisely) who called the command. Then ( 
the server 245 changes the item of the camera indicated '5 
by [target_name] of the item of the user who called the 
command to a mode indicated by [access_mode]. As 
the contents of [accessjnode], a mode for permitting 
an access, and a mode for inhibiting an access are set. 
When the mode for permitting an access is set, M OK" is 20 
displayed in the list 261 shown in Fig. 25: when the mode 
for inhibiting an access is set, "NO" is displayed. There- 
fore, in this embodiment, the camera management serv- 
er 245 can be considered as connection permission set- 
ting means. 25 

In this embodiment, in order to realize means for 
accurately informing the access state to the user, and 
facilitating an access request, processing for changing 
the access permission state, and the like, a GUI (Graph- 
ical User Interface) shown in Fig. 29 is displayed on the 30 
screen 216a. With this GUI, the user can acquire infor- 
mation associated with the current registration state : 
user state, and use permission state of the camera de- 
vices 210. Also, with this GUI, the camera device 210 
can be switched, and the access permission state can- 35 
be changed. An example of an operation using the GUI 
shown in Fig. 29 will be explained below. 

The user can acquire the current access informa- 
tion of the cameras from the camera management serv- 
er 245 by depressing a list update button 273 by a meth- 40 
od similar to the method using the RPC described 
above. The button is depressed by moving a cursor 218 
to a position on a desired button by operating the mouse 
226, and clicking a first button 226a of the mouse. The 
acquired information is displayed on a list window 272. ^5 
On the other hand, the user can set a camera device 
210 to be controlled by operating the mouse 226 or the 
keyboard 227 on the camera state list 250 displayed on 
this list window 272. 

The above-mentioned access request processing so 
and the access end processing, i.e., the sequence 
shown in Fig. 26, are respectively executed by depress- 
ing an access start button 274 and an access end button 
275. On the other hand, in the above-mentioned access 
permission state change processing, i.e., the sequence ss 
shown in Fig. 28, by depressing an access permission 
setting button 276, an image of the list corresponding to 
the access permission list 260 is displayed on the list 



window 272, and a desired access permission state can 
be changed by operating the mouse 226 or the keyboard 
227 on the list. An application end button 277 is de- 
pressed when all the operations end. Therefore, in this 
embodiment, the mouse 226 or the keyboard 227 can 
be considered as a portion of the setting means or the 
connection permission setting means. 

An image window 271 is arranged on the screen 
21 6a, and an image picked up by the camera device 210 
is displayed. The user can control the camera device 
210 by operating pan operation buttons 278a and 278b ; 
tilt operation buttons 278c and 278d. a home position 
return button 278e, and zoom operation buttons 278f 
(enlargement) and 278g (reduction) in a camera control 
section 278 on the screen 216a. With this control, an 
image to be displayed on the image window 271 is 
changed. This control is attained by moving the cursor 
218 to a position on a predetermined button using the 
mouse 226, and clicking the first button 226a of the 
mouse. Note that the operation buttons 278a, 278b, 
278c, and 278d are arranged in correspondence with 
the pan and tilt moving directions, and are easily iden- 
tified. On the other hand, since the home position return 
button 278e is arranged, the camera device 210 can be 
easily returned to its home position (reference position: 
the centers of the pivot angles in the pan and tilt direc- 
tions in this embodiment). In addition, since this button 
278e is disposed at the central blank space of the oper- 
ation buttons 278a, 278b, 278c, and 278d, returning the 
camera device to its home position can be visually un- 
derstood, resulting in an easy operation for the user. 
Note that only one zoom operation button may be ar- 
ranged, and the enlargement/reduction may be desig- 
nated by the first button 226a or a second button 226b 
on the mouse. 

A case will be exemplified below wherein a video 
meeting is held by operating the above-mentioned GUI . 

Prior to the beginning of the video meeting, the vid- 
eo meeting programs 240 and 242, the camera man- 
agement server 245, the camera control server 241 , and 
the camera control panel 243 are started. In considera- 
tion of the functions of these programs, the programs 
are preferably started in this order. However, the pro- 
grams may be simultaneously started in synchronism 
with the power-ON operation of the camera device 210. 
When the user wants to participate in a video meeting 
already in session, the camera management server 245 
need not be started. 

In this state, when the user wants to participate in 
a video meeting, he or she depresses the list update 
button 273 to display the camera state list 250 on the 
list window 272, selects one to be operated of the cam- 
era devices 210 displayed in the camera state list 250, 
and subsequently depresses the access start button 
274. With these operations, the above-mentioned ac- 
cess processing is performed, and the camera device 
210 can be controlled. 

When the user exits the video meeting, he or she 
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depresses the access end button 275. At this time, the 
function [access_end_1 ] is executed, tn this state, since 
the camera device 210 is connected to the network 230, 
it can be controlled by another user and image informa- 
tion transmitted from the camera device 210 can be dis- 
played on the display device 216. When all the opera- 
tions end. the user depresses the application end button 
277. 

To summarize the above description, the sequence 
for accessing the camera from the camera control panel 
243 will be described below with reference to the flow 
charts. 

Fig. 30 shows the sequence executed upon depres- 
sion of the access start button 274. First, an access re- 
quest is issued to the camera management server 241 : 
and the server 241 executes the sequence shown in Fig. 
26 (S301 ). If an access is permitted (Y in S302), a cam- 
era open request is issued to the camera control server 
241, and the server 241 executes the function 
[camera_open] to connect the user who issued the re- 
quest and the camera control server 241 . 

Fig. 31 shows the sequence of the processing ex- 
ecuted by the camera control server 241 in correspond- 
ence with the type of operation upon operation of each 
of the buttons in the camera operation control section. 

When a pan operation is performed, the pan angle 
is set to be a value corresponding to the operation, and 
a function [camera_pan_pos_1] is executed as the pa- 
rameter of [camerajn] type (S312). With this process- 
ing, the camera panpod 21 4 is panned through the angle 
designated by the parameter. 

When a tilt operation is performed, the tilt angle is 
set to be a value corresponding to the operation, and a 
function [camera Jilt_pos_1] is executed as the param- 
eter of [camerajn] type (S313). With this processing, 
the camera panpod 214 is tilted through the angle des- 
ignated by the parameter. 

When a zoom operation is performed, the zoom ra- 
tio is set to be a value corresponding to the operation, 
and a function [camera_zoom_pos_1] is executed as 
the parameter of [camerajn] type (S314). With this 
processing, the camera is zoomed to the ratio designat- 
ed by the parameter. 

Fig. 32 shows the sequence executed when the ac- 
cess end button 275 is depressed. 

The camera control panel 243 requests the camera 
control server 241 to execute a function [camera_close] 
to disconnect the user from the camera (S321 ).. and re- 
quests the camera management server 245 to execute 
the function [access_end_1 ] (S322). The function 
[access_end_1 ] is executed by the camera manage- 
ment server 245, and the user as the parameter of the 
function, i.e., the host where the access end button was 
depressed, is deleted from the host computer which is 
using the camera state list (S331 in Fig. 33). 

Fig. 34 shows the sequence executed when the ac- 
cess permission setting button 276 is depressed. 

The camera control panel 243 sets the access per- 



mission state (OK or NO), which is set by an operator 
based on the displayed access permission list, as the 
parameter (S341), and requests the camera manage- 
ment server 245 to execute the function 

5 [access_change_1 ]. In this manner, the access permis- 
sion list is changed, as set by the parameter (S342). 

In this embodiment, operations and functions de- 
scribed as those of the user can also be regarded as 
those of the camera controller 202. 

w As described above, according to the present in- 
vention, a camera device control system in which a large 
number of users can control camera devices connected 
to a network as needed without stopping the system can 
be provided. 

is Also, a camera device control system in which a 
user can easily participate in or exit a video meeting can 
be provided. 

<Fourth Embodiment 

20 

The fourth embodiment of the present invention will 
be described below with reference to the accompanying 
drawings. 

Fig. 1 is a schematic block diagram showing the ar- 

25 rangement of a video control system according to the 
fourth embodiment. Since the system arrangement is 
the same as that in the first embodiment, a detailed de- 
scription thereof will be omitted. 

Note that the secondary memory 26 stores a cam- 

30 era information file storing position information and view 
field information of each camera 10, a camera state ta- 
ble storing the current camera state information, and 
icon (camera icon) data indicating the respective cam- 
eras 10 in this embodiment, in addition to map data in- 

35 dicating the layout of the cameras 10. The camera in- 
formation file and the camera state table will be de- 
scribed in detail later. 

In this embodiment, cameras to be operated are as- 
sumed to include cameras that allow all the pan, tilt, and 

40 zoom functions to be externally controlled, cameras that 
allow only the zoom function to be externally controlled, 
and cameras which cannot be externally controlled, and 
these cameras will be referred to as rotation/zoom con- 
trollable cameras, zoom controllable cameras, and un- 

45 controllable cameras hereinafter. Therefore, the camera 
control characteristics stored in the secondary memory 
26 must distinguish at least these rotation/zoom control- 
lable, zoom controllable, and uncontrollable cameras 
from each other. As for individual elements (rotations 

so and zoom), the controllable ranges may be stored. In 
the case of an uncontrollable camera, the upper and 
lower limit values of its controllable range need only be 
set to be equal to each other. The camera control circuit 
12 accepts all pan, tilt, and zoom commands if a rota- 

55 tion/zoom controllable camera 1 0 is connected thereto. 
However, if a zoom controllable camera 10 is connected 
to the circuit 12, the circuit 12 accepts only the zoom 
command, and if an uncontrollable camera 10 is con- 
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nected to the circuit 12, the circuit 12 accepts none of 
these commands. If an unacceptable command is input 
to the circuit 1 2, the circuit 1 2 returns an error signal to 
the unit 20. 

Fig. 35 shows an example of the display screen on 
the bit-map display 28. Assume that a window display 
system capable of simultaneously displaying a plurality 
of windows is running on the bit -map display 28. A map 
indicating, e.g., the office layout is displayed on a map 
window 340, and camera icons 342-1 to 342-7 indicating 
the positions of the plurality of cameras 10 disposed in 
the office are displayed on the map. As will be described 
in detail later, the camera icons 342-1 to 342-7 are dis- 
played in substantially the same directions as those of 
the corresponding cameras, and their pan ranges and 
current field angles are simultaneously displayed. 

An image output from the camera 10 selected by 
the camera selector 32 is displayed on an image window 
344. Note that the camera icon corresponding to the se- 
lected camera is displayed in a color different from those 
corresponding to the non-selected cameras so as to 
identify the selected camera 1 0 on the map window 340. 

An operation panel 346 is displayed under the im- 
age window 344. On the operation panel 346, rotation 
operation buttons used for the pan and tilt operations 
and a slide button used for the zoom operation are dis- 
played. By operating these buttons, the rotation and 
zoom operations of an arbitrary designated camera can 
be attained. When the selected camera is a zoom con- 
trollable camera (i.e., a rotation uncontrollable camera), 
the rotation operation buttons are displayed in an inop- 
erable state, and when the selected camera is an un- 
controllable camera, both the rotation and zoom opera- 
tion buttons are displayed in an inoperable state. 

Fig. 36 is an enlarged view of the camera icons 
342-1 to 342-7. The camera icon of this embodiment is 
formed by a camera body figure 350 indicating the cur- 
rent direction of the camera, a fan-shaped maximum 
pan angle figure 352 indicating the maximum pan angle 
range, and a fan-shaped current field angle figure 354 
indicating the current photographing range. In the un- 
controllable camera, the maximum pan angle figure 352 
has a fan shape having an angle of 0°, i.e., becomes a 
straight line. In this case, whether or not such a line is 
displayed depends on a user's favor. For this reason, 
whether or not such a line is displayed is preferably se- 
lected by a user. The maximum pan angle figure 352 
and the current field angle figure 354 should have dif- 
ferent display colors and patterns to be sufficiently iden- 
tifiable from each other. The current field angle is deter- 
mined by the focal length of the photographing lens. 

Fig. 37 shows the architecture of the camera infor- 
mation file and an example of data. As shown in Fig. 37, 
the camera information file stores the camera number 
as a serial number inherent to the camera, the camera 
setting position (X, Y), the camera setting direction (the 
direction of the center of the camera when the pan angle 
= 0°), the control characteristics (0: rotation/zoom con- 



trollable, 1: zoom controllable, 2: uncontrollable), the 
maximum field angle (the field angle when the zoom ra- 
tio = 1.0), the maximum pan angle, and the maximum 
zoom ratio. Note that the camera setting angle is ex- 
5 pressed as an angle with respect to an x-axis while as- 
suming an x-y coordinate system on the map. 

Fig. 38 shows the architecture of the camera state 
table and an example of data. As shown in Fig. 38, the 
camera state table stores the camera number, the cur- 
10 rent camera direction, and the current zoom ratio. The 
camera number in the camera state table is used for lin k- 
ing the camera information file shown in Fig. 37. As for 
the current camera direction and the current zoom ratio, 
each time a mouse operation is performed on the oper- 
as ation panel 346, the corresponding portion of the select- 
ed camera is updated. The current camera direction is 
effective for only cameras having the rotation function, 
and the current zoom ratio is effectively for only cameras 
having the zoom function. 
?0 Fig. 39 is a flow chart showing the map display op- 
eration by the CPU 22 in this embodiment. 

The CPU 22 reads map data stored in the second- 
ary memory 26, and displays the read map on the map 
window 340 (step S3901). Then, the CPU 22 reads the 
25 camera information file storing the position information 
and view field information of the disposed cameras, and 
the camera state table storing the current camera state 
information (step S3902), and draws the camera icons 
342-1 to 342-7 on the corresponding positions on the 
30 map window 340 on the basis of these pieces of infor- 
mation, as shown in Fig. 35 (step S3903). The CPU 22 
then waits for a mouse operation by a user (step S3904). 

When one of the camera icons 342-1 to 342-7 on 
the map window 340 is selected by clicking the mouse 
35 (step S3905), the CPU 22 changes the color of the se- 
lected one of the camera icons 342-1 to 342-7 to one 
(in this case, red) indicating the selected state, and ac- 
quires the camera number of the camera icon from the 
camera information file (step S3906). Assume that the 
40 camera 1 0-n is selected. The CPU 22 supplies a camera 
switch command to the camera selector 32 to switch the 
control signal line and the camera output to those of the 
camera 10-n (step S3907). The output from the camera 
1 0-n is supplied to the display 28 via the camera selector 
45 32, the video capture device 34, and the bus 38, and an 
output image is displayed on the image window 344. 

If the operation panel 346 under the image window 
344 is operated (step S3908), the CPU 22 transmits a 
camera control command corresponding to the opera- 
te tion contents to the camera control circuit 12-n via the 
camera selector 32 (step S3909). Of course, the user is 
allowed to perform only an operation corresponding to 
the control characteristics (rotation/zoom controllable, 
zoom controllable, or uncontrollable) of the currently se- 
55 lected camera 10-n. The camera control circuit 12-n 
controls the camera 10-n in accordance with the re- 
ceived camera control command. At the same time, the 
CPU 22 updates the display state of the selected cam- 
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era icon to match a new state. 

The display operation (step S3903) and the updat- 
ing operating (step S3910) of the camera icon will be 
described in detail below with reference to Fig. 40. Dif- 
ferent processing operations are performed depending 
on the control characteristics (step S3921). If the cur- 
rently selected camera is an uncontrollable one (step 
S3921), the current field angle figure 354 is displayed 
(step S3922). The current field angle figure 354 to be 
drawn has a fan shape which has a predetermined ra- 
dius and spreads through an angle 1/2 the maximum 
field angle on the two sides of the camera setting direc- 
tion to have the camera setting position as the center. ■ 
Then, the camera body figure 350 is displayed to be su- 
perposed on the current field angle figure 354 in a state 
wherein the center of the figure 350 is set at the camera 
setting coordinate position : and the figure 350 points to 
the camera setting direction (step S3923). For example, 
the camera icon corresponding to camera number 3 in 
Fig. 37 is displayed, as shown in Fig. 41 . 

If the currently selected camera is a zoom control- 
lable one (step S3921 ), the current field angle figure 354 
is displayed (step S3924). The current field angle figure 
354 to be drawn has a fan shape which has a predeter- 
mined radius and spreads through an angle 1 12 the max- 
imum field angle on the two sides of the camera setting 
direction to have the camera setting position as the cent- 
er. Then, the camera body figure 350 is displayed to be 
superposed on the current field angle figure 354 in a 
state wherein the center of the figure 350 is set at the 
camera setting coordinate position, and the figure 350 
points to the camera setting direction (step S3925). For 
example, the camera icon corresponding to camera 
number 4 in Fig. 37 is displayed, as shown in Fig. 42, in 
the current state shown in Fig. 38. 

If the currently selected camera is a rotation/zoom 
controllable one (step S3921), the maximum pan angle 
figure 352 is displayed (step S3926). The maximum pan 
angle figure 352 to be drawn has a fan shape which has 
a predetermined radius and spreads through an angle 
1 /2 the maximum pan angle on the two sides of the cam- 
era setting direction to have the camera setting position 
as the center. Then, the current field angle figure 354 is 
displayed on the maximum pan angle figure 352 (step 
S3927). The current field angle figure 354 to be drawn 
has a fan shape which has a predetermined radius and 
spreads through an angle 1/2 the current field angle on 
the two sides of the current camera direction to have the 
camera setting position as the center. Finally, the cam- 
era body figure 350 is displayed to be superposed on 
the maximum pan angle figure 352 and the current field 
angle figure 354 so that its center is set at the camera 
setting position, and it points to the camera direction 
(step S3928). For example, the camera icon corre- 
sponding to camera number 5 in Fig. 37 is displayed, as 
shown in Fig. 43, in the current state shown in Fig. 38. 
More specifically the camera points to the direction of 
255°, and its pan angle is 180' to have, as the center, 



270° as the setting angle. On the other hand, the field 
angle is 1 20° to have the camera direction as the center. 

Camera control signals to be supplied from the CPU 
22 to the camera control circuit 12 via the camera se- 

5 lector 32 in response to an operation on the operation 
panel 346 can be the same as control commands for a 
normal externally controllable camera. In this embodi- 
ment, for example, when a right-arrow button on the op- 
eration panel 346 is depressed, the CPU 22 supplies a 

10 pan control command in the clockwise direction to the 
camera control circuit 12 of the camera 10 selected at 
that time via the camera selector 32. At the same time, 
the CPU 22 updates the current camera direction and 
the current zoom ratio in the camera state table. 

is The current field angle, Be, of the camera is calcu- 
lated according to the following formula on the basis of 
the maximum field angle. Hmax, and the current zoom 
ratio, K: 

He - 2 arctan{(tan (Umax/2))/K} 

20 In this embodiment, the current camera directions of all 
the externally controllable cameras are set to be values 
equal to those of their camera setting directions as initial 
values in the camera state table, and the current zoom 
ratio is set to be 1 .0. 

25 The above-mentioned embodiment can be easily 
extended to a system that can be applied to a network. 
For example, as shown in Fig. 6. a plurality of camera 
operation apparatuses 50-1 to 50-n each having-the 
same arrangement as that of the camera control system 

30 shown in Fig. 1 are connected to a network 52. As the 
network 52, a local area network LAN or a wide area 
network WAN which has a bandwidth large enough to 
transmit digital motion image data captured by the video 
capture device 34 and camera control signals is as- 

35 sumed. However, the present invention is not limited to 
these networks. 

Each of the camera operation apparatuses 50-1 to 
50-n can output video data captured by the video cap- 
ture device 34 as a packet via the network interface 36, 

40 and can receive a video data packet from the network 
52. The bit-map display 28 displays video data captured 
by the video capture device 34 and video data received 
from the network 52 on the image window. Each of the 
camera operation apparatuses 50-1 to 50-n can trans- 

45 mit data onto the network 52 via the network interface 
36, and can receive data from the network 52. The cam- 
era operation commands and the camera switch com- 
mand received from the network 52 are processed in 
the same manner as those generated in each appara- 

50 tus. Such a technique is known to those who are skilled 
in the art. 

Note that the camera information additionally in- 
cludes an item of apparatus addresses and an item of 
map names (i.e., office names) in correspondence with 
55 the network, as shown in Fig. 44. Upon selection of a 
camera, the apparatus address and/or the map name 
must be selected using, e.g. , a menu to switch the cam- 
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era operation apparatus and/or the map. Note that the 
item of map names is effective not only for the network 
but also for a case wherein cameras are disposed at 
remote places, and cannot be drawn on a single map. 
More specifically: a plurality of maps need be selectively 
displayed on the map window 340. Upon selection of a 
camera, the map and/or the camera operation appara- 
tus to which the camera to be operated is connected are 
and/or is selected using, e.g., a menu as needed. 

When the camera to be controlled is selected, and 
its camera number is detected, the table shown in Fig. 
44 is looked up to obtain the apparatus address based 
on the camera number. When the selected camera can- 
not be directly controlled, i.e., must be controlled via the 
network, camera operation commands and camera 
switch command are issued via the network. In the cam- 
era image display operation, if the camera operation ap- 
paratus at which a camera operation input is performed 
is represented by A, and the camera operation appara- 
tus to which the selected camera is connected is repre- 
sented by B, when the map is displayed and the camera 
is selected, the apparatus A requests the apparatus B 
to transmit a camera image, and video data captured by 
the apparatus B is transmitted to the apparatus A via the 
network. 

As described above, when this embodiment is ap- 
plied to a network, even when the number of inputs of 
the camera input selector is limited, a larger number of 
cameras can be controlled. One or a plurality of cameras 
at remote places can be easily bidirectionally controlled. 

The pan angle range is expressed by the maximum 
pan angle figure. In place of or in addition to this figure, 
an image inputtable range may be displayed as a figure 
on the basis of the maximum pan angle information and 
the maximum field angle information. For example, a fan 
shape which has a predetermined radius may be drawn 
and spreads through an angle corresponding to the sum 
of an angle 1/2 the maximum pan angle and an angle 
1 12 the maximum field angle on the two sides of the cam- 
era setting direction to have the camera setting position 
as the center may be drawn. The central angle of this 
fan-shaped figure represents an actual maximum pho- 
tographing range. 

As can be easily understood from the above de- 
scription, according to the system of this embodiment, 
since information such as the direction, view field angle, 
maximum pan angle, and the like of each video input 
means, i.e., the camera, is visually displayed, the per- 
formance and the current state of each video input 
means can be visually recognized. More specifically, a 
visual user interface that is easy to use can be provided. 

<Fifth Embodiment 

The fifth embodiment of the present invention will 
be described in detail below with reference to the ac- 
companying drawings. 

Fig. 45 is a schematic block diagram showing the 



arrangement of a video communication apparatus as a 
basic element in the fifth embodiment of the present in- 
vention, i.e., a computer system to which a plurality of 
camera devices are connected. Systems having the ar- 
s rangement shown in Fig. 45 or systems having a similar 
arrangement are connected to each other via a compu- 
ter network. 

Referring to Fig. 45, reference numeral 10 (10-1, 
10-2, 10-3,...) denotes video cameras: 12(12-1, 12-2, 

10 12-3,...), camera control circuits for directly controlling 
panning, tilting, zooming, focusing, aperture adjust- 
ment, and the like in accordance with external control 
signals; and 32, a camera input selector for selecting 
one to be controlled of the video cameras 1 0, from which 

is an output signal is to be fetched. Note that the output 
signal is normally a video signal, but in the case of a 
camera with a microphone, the output signal includes a 
video signal and an audio signal. In the following de- 
scription, the output signal is assumed to be only a video 

20 signal. As control signal lines, for example, RS-232C in- 
terfaces are used. However, the present invention is not 
limited to these. 

A camera operation unit 4520 controls the camera 
selector 32 via an I/O 4501, and supplies control com- 

25 mands to the desired camera control circuit 12 via the 
camera selector 32, thereby controlling the video cam- 
era 10 connected to the circuit 1 2. The camera operation 
unit 4520 comprises a computer system. Reference nu- 
meral 22 denotes a CPU for controlling the entire appa- 

30 ratus; 24, a main memory for storing programs and the 
like executed by the CPU 22: 26, a secondary memory 
(e.g.. a hard disk device); 30, a mouse: and 4503, a key- 
board. 

Reference numeral 4501 denotes an I/O port for 

35 connecting the camera selector 32 and supplying cam- 
era control commands and the like to the camera selec- 
tor 32; 4502, a video board for capturing a video signal 
output from the video camera 1 0 selected by the camera 
selector 32, and displaying various kinds of images on 

40 a bit-map display 28: 36, a network interface for con- 
necting the unit 20 to a computer network or a commu- 
nication network; and 38, a system bus for connecting 
the respective devices (the CPU 22 to the network in- 
terface 36). Using the network interface 36, camera con- 

45 trol signals can be supplied from a remote place to the 
camera operation unit 20 via the network so as to control 
the camera 10. 

The camera selector 32 selects one of the control 
signal lines and one of video outputs connected to the 

so plurality of camera control circuits 12, and supplies the 
selected video output to the video board 4502. In addi- 
tion, the camera selector 32 logically connects the se- 
lected control signal line to the I/O port 4501 . As the for- 
mat of a video signal, for example, an NTSC signal of 

55 the luminance color difference separation method is 
known. The video board 4502 captures the video output 
selected by the camera selector 32. The captured video 
signal is displayed as a motion image on a predeter- 
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mined window of the bit-map display 28, or is transferred 
to another apparatus. 

The secondary memory 26 stores various kinds of 
information associated with the cameras 10, for exam- 
ple, camera position information data, camera figure da- 
ta, and the like. These data will be described in detail 
later. 

When only one camera 1 0 is connected, the camera 
selector 32 can be omitted, and the camera control cir- 
cuit 12 is directly connected to the I/O port 4501 . When 
no image is transmitted, the camera 1 0, the camera con- 
trol circuit 12, and the camera selector 32 are omitted. 

The apparatus shown in Fig. 45 is connected to a 
network, as shown in, e.g., Fig. 46. Referring to Fig. 46, 
a terminal A has the same arrangement as that of the 
apparatus shown in Fig. 45. In a terminal B, since only 
one camera is connected, the camera control circuit is 
directly connected to the I/O port. In a terminal C, no 
camera is connected. In general, the terminals A, B, and 
C with various arrangements are connected to a single 
network. As the network used in this embodiment, a LAN 
or WAN having a transmission bandwidth large enough 
to transmit digital motion image data and camera control 
signal is assumed. 

The video board 4502 has a video capture function, 
as described above, and supplies the captured video 
data not only to the bit-map display 28 to be displayed 
thereon, but also to the CPU 22 via the bus 38. The CPU 
22 converts the video data into a packet, and outputs 
the packet onto the network via the network interface 
36. From the network interface 36, camera operation 
commands, a camera switch command, and the like are 
also output onto the network as packets. Furthermore, 
information associated with the entire system is also 
sent onto the network as a packet. Such information is 
transmitted to a specified transfer destination or all the 
terminals depending on the contents of data to be trans- 
mitted and as needed. 

The same applies to reception. More specifically, 
upon reception of video data, and camera operation and 
camera switch commands as packets, the terminals A, 
B, and C process the received data in the same manner 
as their internally captured data, and process the re- 
ceived camera operation and camera switch commands 
in the same manner as their internal commands. The 
information associated with the entire system is used for 
updating a system display of a user interface (to be de- 
scribed later). 

Fig. 47 shows the software arrangement in this em- 
bodiment. Fig. 47 illustrates software programs to be 
classified into software programs (servers) to be in- 
stalled in a terminal to which a camera device is directly 
connected, and software programs (clients) to be in- 
stalled in a terminal which remote -controls the camera 
device, in association with camera operations. Of 
course, in a normal use state, both the types of software 
programs are installed in a single terminal. 

In Fig. 47. workstations 450, 452. 454, and 456 are 



connected to a network 457. A camera device 458 as 
the camera 10 is connected to the workstation 450, and 
monitors (bit-map displays) 460 and 462 are respective- 
ly connected to the workstations 452 and 454. The work- 
5 station 456 manages a camera which can be remote- 
controlled via the network, the rights, the use states, and 
the like in units of users in the network, as will be de- 
scribed later. 

The workstation 450 stores a video transmission/re- 
?0 ception software program for transmitting image infor- 
mation (motion image) obtained by the camera 458 to 
another workstation via the network 457, and a camera 
control server (software program) 466 for controlling the 
camera device 458 in accordance with camera control 
is signals from other workstations 452 and 454. 

In the workstation 456, a camera management 
server (software program) 468 is installed. The camera 
control server 466 reads a camera initial setting file in- 
cluding information shown in Fig. 48 upon starting of the 
20 camera 458, and informs the camera names and initial 
states (setting positions, initial directions, and zoom val- 
ues) of all the cameras connected to a single worksta- 
tion to the camera management server 468. The camera 
initial setting file is stored in the secondary memory. The 
25 camera management server 468 registers data indicat- 
ing that the camera 458 can be actually utilized via the 
network 457 in a camera list in response to a registration 
request from the camera control server 466. 

Each of the workstations 452 and 454 stores a video 
30 transmission/reception software program 470 for re- 
ceiving an image (motion image) from the workstation 
450 and displaying the received image on a correspond- 
ing one of the monitors 460 and 462, a camera control 
client (software program) 472 for displaying the state of 
35 the camera (in this case, the camera 458), displaying a 
camera display control panel used for remote-control- 
ling a controllable camera, and processing the operation 
on the control panel, and an initial setting edit software 
program 474 for editing the initial setting data of this 
40 camera control system. 

The users of the workstations 452 and 454 can look 
up, add, and correct various kinds of information man- 
aged by the camera management server 468 using their 
camera control clients 472, as will be described in detail 
45 later. Note that when the connection (reception of a 
picked-up image and remote control) with a camera (in 
this case, the camera 458) of another workstation is per- 
mitted by the camera management server 468, the cam- 
era control client 472 can transmit camera control sig- 
50 nals to another workstation (in this case, the camera 
control server 466) without going through the camera 
management server 468. 

In a normal use method, both a monitor and a cam- 
era device are connected to each workstation. For this 
55 reason, video transmission/reception software pro- 
grams 464 and 470 normally comprise both the func- 
tions of video transmission and video reception. In gen- 
eral, each software program consists of a single pro- 
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gram or a group of program modules. Each of the ter- 
minals A and C shown in Fig. 46 comprises the work- 
stations 450 and 452 or 454 shown in Fig. 47, and the 
terminal B shown in Fig. 46 comprises the workstation 
452 or 454. The workstation 456 shown in Fig. 47 cor- 
responds to the terminal A, B, or C in Fig. 46. 

The camera management server 468 is a software 
program for managing all the cameras which are open 
to the network 457 fully or limitedly. The camera man- 
agement server 468 holds information associated with 
the camera names, setting positions, directions, and 
use states of all the cameras connected to the network 
457, and manages registration upon connection of a 
camera to the network 457, deletion upon disconnection 
of a camera from the network 457, and access permis- 
sion/rejection with respect to a camera access request 
from a user. Furthermore, the camera management 
server 468 periodically informs camera information to 
all the camera control clients via the network. 

In Fig. 47, the camera management server 468 is 
installed in a special-purpose workstation, but may be 
installed in any one of workstations (in Fig. 47, the work- 
stations 450, 452, and 454) connected to the network 
457, as a matter of course. Alternatively, the camera 
management server may be installed in advance in all 
the terminals which are to be connected to the network, 
and the camera management server 468 may be started 
in one of two terminals which start, e.g., a video meeting 
for the first time. 

Fig. 49 shows an example of the camera display 
control panel displayed on each of the monitors 460 and 
462 by the camera control client 472. The camera con- 
trol client 472 sets and displays, on the monitor screen, 
a map window 80 on which camera icons indicating the 
setting positions and directions of cameras are super- 
impose-displayed on a map indicating the setting posi- 
tions of controllable cameras, an image window 84 for 
displaying a camera image, a camera operation panel 
86 consisting of various camera control buttons, and a 
current value display window 88 for displaying the pa- 
rameter values of the currently selected camera. In this 
embodiment -assume that a window display system ca- 
pable of simultaneously displaying a plurality of win- 
dows is running. On the map window 80, the map indi- 
cating the seat layout in an office is displayed, and cam- 
era icons 82-1 to 82-6 indicating the setting positions of 
cameras disposed in the office are displayed on the 
map. The camera icons 82-1 to 82-6 are displayed in 
substantially the same directions as the current direc- 
tions of the correspond imeras. 

On the video windc 4. an image output from the 
selected camera is disp Note that the camera icon 
corresponding to the se= a' camera is displayed in a 
color different from thos ■■ the camera icons corre- 
sponding to the non-selec . cameras so as to identify 
the selected camera on the map window 80. 

The operation panel 86 is displayed below the im- 
age window 84. The operation panel 86 comprises ro- 



tation operation buttons 861 used for pan and tilt oper- 
ations, and two buttons 862 for a zoom operation. Upon 
operation of these buttons, rotation and zoom opera- 
tions of an arbitrary designated camera can be attained. 
5 When the selected camera is an uncontrollable camera, 
the rotation and zoom operation buttons are displayed 
in an inoperable state. The current value display window 
88 displays the current values (the setting position, pan 
angle, tilt angle, and zoom value) of the selected cam- 
io era. 

For example, when a certain user wants to access 
(remote-control) a given camera, he or she double- 
clicks the camera icon indicating the target camera. In 
response to this operation, the camera control client 472 
>s requests the right of operation of the target camera to 
the camera management server 468, and the camera 
management server 468 permits the remote control (in- 
cluding a display of an image) of the camera when none 
of users are currently using the camera. On the other 
20 hand, when another user has already been operating 
the camera, the server 468 rejects the right of remote 
control. When the right of operation is permitted, an im- 
age output from the camera is displayed on the image 
window 84, and the operations (pan, tilt, and zoom op- 
2S erations) using the camera operation panel 86 can be 
performed. 

In this embodiment, the addition, removal, move- 
ment, and change in initial direction of a camera man- 
aged by each terminal can be reflected in the initial set- 
^o ting file by a simple operation via the initial setting edit 
software program 474 

Fig. 50 shows an example of the display screen of 
the initial setting edit s-r-itware program 474, and Fig 51 
is an operation flowch of the program 474. The same 
35 reference numerals in rig. 50 denote the same opera- 
tions corresponding to steps in Fig. 5 1 . The initial setting 
edit software program 474 is started by the camera con- 
trol client 470, but can be started independently. 

The initial setting edit software program 474 reads 
to the camera initial setting file shown in Fig. 48 when it is 
started (step S5101), and displays the camera layout 
map shown in Fig. 50 on the basis of information includ- 
ed in the read file (step S5102). Then, the program 474 
enters an event waiting loop (step S5103). The contents 
45 of the camera initial setting file are held in the initial set- 
ting edit software program 474 as a camera initial setting 
list. 

The display screen shown in Fig. 50 will be ex- 
plained below. The display screen includes a map dis- 
olay section 90 and a command icon section 92. The 
lap display section 90 superimpose-displays camera 
Jons on the map in the same manner as the map win- 
dow (Fig. 49) of the camera display control panel. The 
camera icons are disposed at the setting positions of the 
ss cameras registered in the initial setting file to point to 
their initial directions. The command icon section 92 dis- 
plays a new icon 92-1 for adding a new camera, a de- 
letion icon 92-2 for deleting an existing camera, and an 
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end icon 92-3 for determining the change and ending 
the initial setting edit software program 474. 

If some event has occurred in the event waiting 
loop, it is checked if the event requires processing (step 
S5104, S5110, S5117, S5122), and the corresponding 
processing is executed. 

A case will be exemplified below wherein a new 
camera is set. In this case : a mouse button is depressed 
while the mouse cursor indicates the new icon 92-1 
(step S5104). The initial setting edit software program 
474 generates and displays a new camera icon denoted 
by reference numeral 94-1 in Fig. 50. The user moves 
the mouse cursor to a desired position while selecting 
the camera icon 94-1 (step S5105), and then releases 
the mouse button (step S5106). More specifically, the 
user drags the camera icon 94-1 to the desired position. 
If the release position of the mouse button falls outside 
the map region (step S5107), the flow returns to the 
event waiting loop; if the release position falls within the 
map region (step S5107), a dialog box 96 for inputting 
the camera name is displayed to prompt the user to input 
the camera name of the new camera (step S5108). 

In this manner the setting position and camera 
name of the new camera are determined, and are addi- 
tionally registered in the camera initial setting list (step 
S5109). 

When an existing camera is to be moved or re- 
moved, the following operation is performed. The cam- 
era icon (e.g. ; 94-2) of the camera to be moved or re- 
moved is selected (step S5110) and is dragged to the 
destination position in the case of movement or to the 
deletion icon 92-2 in the case of removal (step S5111). 
Then, the mouse button is released (step S5112). If the 
release position of the mouse button falls within the map 
region (step S5113), the camera setting position on the 
camera initial setting list is updated to the release posi- 
tion of the mouse button as a new camera setting posi- 
tion (step S5114). If the release position of the mouse 
button falls outside the map region (step S5113) and is 
located above the deletion button 92-2 (step S51 1 5), in- 
formation of the camera indicating the dragged camera 
icon is deleted from the camera initial setting list (step 

55116) . More specifically., all the pieces of information 
associated with the camera to be removed are deleted 
from the camera initial setting list. On the other hand, if 
the release position of the mouse button falls outside 
the map region (step S5113) and is not located above 
the deletion button 92-2 (step S5115), the camera icon 
is returned to the position before dragging, and the flow 
returns to the event waiting loop. 

When the initial direction of a camera is to be 
changed, the following operation is performed. The 
mouse cursor is moved to a position in a surrounding 
portion (a circular region having the center of the camera 
icon as its central point and a predetermined radius) of 
the camera icon, the initial direction of which is to be 
changed, and the mouse button is depressed (step 

551 1 7) . Upon depression of the mouse button, the initial 



setting edit software program 474 displays a dotted ar- 
row 98 extending from the center of the camera icon as 
the start point in the current initial direction (step S51 1 8). 
The direction of the arrow 98 indicates the pan angle. 
5 and its length indicates the tilt angle. By moving the 
mouse cursor while holding down the mouse button, the 
direction and length of the arrow 98 are changed (step 
S511 9). When the arrow 98 has a required direction and 
length, the mouse button is released (step S5120). The 
w changed direction and length become the initial values 
of the pan and tilt angles. Then, the contents of the cam- 
era direction on the camera initial setting list are 
changed (step S5121). 

When the user wants to end the camera initial set- 
's ting edit software program 474, he or she moves the 
mouse cursor to a position above the end button, and 
clicks the mouse button (step S5122). In response to 
this operation, the camera initial setting edit software 
program 474 updates the camera initial setting file with 
20 the information of the camera initial setting list held in 
the program (step S5123). 

Thereafter, when the entire system is restarted, the 
contents changed in steps S5109, S5114, S5116, or 
S5121 are reflected in the respective software pro- 
25 grams, i.e., the camera control server 466, the camera 
management server 468, and the camera control client 
472. Using the initial setting edit software program 474, 
the user can visually and interactively create and 
change the initial setting file that describes the camera 
30 layout. 

In consideration of a possibility that a large number 
of cameras are disposed at remote positions, e.g., cam- 
eras are disposed in different rooms or different floors, 
it is preferable to use a plurality of maps. For this pur- 

35 pose, a function of selecting a map can be added to the 
information shown in Fig. 49 as the camera display con- 
trol panel displayed on the monitor 460 or 462 by the 
camera control client 472. Fig. 52 shows an example of 
such panel. The same reference numerals in Fig. 52 de- 

40 note the same constituting elements as in Fig. 49. Ref- 
erence numeral 89 denotes a map list display column 
for displaying a list of a plurality of maps. A selected one 
of the maps displayed in this list is displayed on the map 
window 80 together with camera icons indicating the 

45 cameras which are set there. Such a list may be dis- 
played in the form of a menu on the upper portion of the 
screen or of a floating palette. 

A plurality of pieces of map information are stored 
in, e.g., the camera management server 468, and the 

50 camera control client 472 receives the camera initial set- 
ting information and required maps from the camera 
management server 468 when it is started. The plurality 
of maps are managed, as shown in, e.g., Fig. 53. A map 
information file 5301 includes map number (ID) data, 

55 floor name data, bit-map file name data of map data, 
and the size of the bit-map data. The map information 
file 5301 is stored in the workstation 456 in which the 
camera management server 468 is installed. The cam- 



19 



37 



EP 0 715 453 A2 



era management server reads this file 5301 upon start- 
ing, and holds it therein. The map information file and 
map data are transferred to the camera control client as 
needed. 

An item of map names corresponding to the cam- 
eras must be added to the camera list managed by the 
camera management server 468. Similarly, an item of 
floor names corresponding to the cameras is added to 
the camera initial setting information stored as the cam- 
era initial setting file, as shown in Fig. 54. In this case, 
the floor name may be replaced by the map ID. On the 
camera display control panel, only cameras set on the 
maps displayed on the map window 80 can be selected 
and operated. 

In consideration of addition, removal, and move- 
ment of cameras, the function of adding and deleting a 
map is added to the initial setting edit software program 
474. Fig. 55 shows the screen displayed when the func- 
tion of the initial setting edit software program 474 is ex- 
tended to accommodate this function. A map display 
section 100 displays a map in the same manner as in 
the map display section 90 shown in Fig. 50, and camera 
icons corresponding to the cameras to be set are super- 
impose-displayed on the map. Note that the map to be 
displayed in Fig. 55 is selected from the map list. A com- 
mand icon section 102 displays a new icon 102-1 for 
adding a new camera, a new map icon 1 02-2 for adding 
a map, a map list display column 102-3 for displaying 
the map list, a deletion icon 1 02-4 for deleting a camera 
icon and a map, and an end icon 102-5 for determining 
a change and ending the initial setting edit software pro- 
gram 474. 

Fig. 56 is an operation flow chart of the initial setting 
edit software program 474 whose function is extended, 
as described above. Note that common steps associat- 
ed with the operation of the camera icon described 
above with reference to Fig. 51 are expressed as a sin- 
gle block S34, and a detailed description thereof will be 
omitted. 

First, the map information file 5301 and a camera 
initial setting file 5401 which are saved in the formats 
shown in Figs. 53 and 54 are read (step S31), and the 
camera layout map shown in Fig. 55 is displayed based 
on the information contents in the files (step S32). Then, 
the control enters an event waiting loop (step S33). Note 
that the contents of the map information file 5301 and 
the camera initial setting file 5401 are respectively held 
as a map list and a camera initial setting list in the pro- 
gram. 

If some event has been generated in the event wait- 
ing loop, it is checked if the event requires processing 
(steps S34 ; S35, S38, S45), and the corresponding 
processing is executed. 

If the user clicks the new map icon 102-2 using the 
mouse cursor in the event waiting loop (step S35), a di- 
alog box 104 (Fig. 55) is displayed to prompt the user 
to input the name of a map to be added and map infor- 
mation such as the bit-map file name (step S36). Upon 



completion of the input operation, the input information 
of the new map is added to the map list held in the pro- 
gram, and the changed map list is re-displayed on the 
map list display column 102-3 (step S37). Thus, the 
$ newly added map can be selected on the map list dis- 
play column 102-3. 

If the user depresses the mouse button on one of 
map names displayed on the map list display column 
102-3 in the event waiting loop (step S38), the control 
10 enters the change processing of the displayed map or 
the deletion processing of the map. More specifically, 
when the user immediately releases the mouse button, 
the operation is considered as a clicking operation (step 
S39), and the map displayed on the map display section 
15 1 00 is changed to the map selected on the map list dis- 
play column 102-3 (step S40). When the mouse cursor 
is moved while holding down the mouse button (step 
S39), the map name selected on the map list display 
column 102-3 is moved upon movement (dragging) of 
20 the mouse cursor (step S41). When the mouse button 
is released at a position above the deletion icon 102-4 
(steps S42, S43), the map name is deleted from the map 
list display column 102-3 (step S44). Of course, in order 
to prevent a deletion error, a dialog box for confirming 
25 deletion is displayed, and the information of the selected 
map is deleted from the map list under the confirmation 
of the user. At the same time, information of each cam- 
era present on the corresponding map is deleted. When 
the mouse button is released at a position other than 
30 that above the deletion icon 102-4 (step S43), no 
processing is performed, and the flow returns to the 
event waiting loop. 

When the user depresses the mouse button while 
setting the mouse cursor above the end button 102-5 
35 (step S45), the contents of the initial setting information 
are saved in the initial setting file, and the program ends 
(step S46). The contents of the initial setting information 
are classified into information associated with the maps 
shown in Fig. 53 and information associated with the 
40 cameras shown in Fig. 54, and are respectively saved 
in the map information file 5301 and the camera initial 
setting file 5401 In order to validate the changed infor- 
mation, the entire system must be restarted. 

In order to validate the changed contents of the in- 
45 itial setting information without restarting the system, 
when the initial setting information is changed, the 
changed contents are informed to the camera manage- 
ment server 468, and the camera management server 
468 informs the camera control clients 472 of them. Fig. 
50 57 shows this information sequence. Fig. 57 illustrates 
the sequence in which the initial setting edit software 
program 474, the camera control server 466, the cam- 
era management server 468, and the camera control cli- 
ent 472 inform each other of the changed contents of 
55 the initial setting information of the system via commu- 
nications using the network. 

As has been described above with reference to Fig. 
56, the initial setting edit software program 474 writes 
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the changed initial setting information in the camera in- 
itial setting file 5401 and the map information file 5301 
(step S51 ). The camera initial setting file 5401 may be 
divisionally saved in the respective camera control serv- 
ers 466 or may be saved as a single file. The file 5401 s 
may be saved in the secondary memory of any terminal 
connected to the network. Normally, the file 5401 may 
be saved in the secondary memory of the terminal in 
which the camera management server 468 is installed. 

The initial setting edit software program 474 in- 10 
forms, of the changed initial setting information, the 
camera management server 468 and the camera con- 
trol server (or servers) 466 on the terminal to which the 
camera corresponding to the changed information is 
connected, and ends the processing (step S52). The *5 
present invention is not particularly limited to the infor- 
mation method. For example, a socket communication 
using an RPC (Remote Procedure Call) or TCP/IP may 
be used. The same applies to the interprocess commu- 
nications in the subsequent processing : and the com- 20 
munication method is not limited to a specific method. 

Upon receiving the changed initial setting informa- 
tion, the camera management server 468 reads the map 
information file 5301 , and updates the map list in the file 
(step S56). On the other hand, the camera control server 25 
466 reads the camera initial setting file 5401 (step S53), 
and if a new camera is connected under the control of 
the server 466, the server 466 attempts to start the new- 
ly connected camera (step S54). If the camera is suc- 
cessfully started, the server 466 requests registration of 30 
the new camera to the camera management server 468 
(step S55). When the power switch of the camera is not 
turned on, starting of the camera fails. In this case, the 
server 466 does not request registration of this camera 
to the camera management server 468. When the posi- - 35 
tion (and direction) of an existing camera is changed, 
the camera control server 466 which controls the cam- 
era of interest informs re-registration of the new setting 
position (and direction) to the camera management 
server 468 (step S55). 40 

Upon receiving the registration or re-registration re- 
quest from the camera control server 466, the camera 
management server 468 updates information associat- 
ed with the initial setting information in the camera list 
(step S57). Thereafter the server 468 informs all the -*5 
camera control clients 472 of the changed contents of 
the system, and transmits new initial setting information 
(step S58). 

Upon receiving the changed contents of the system, 
each camera control client 472 updates its display state so 
on the basis of the received initial setting information 
(step S60). 

In this manner, changed contents of the initial set- 
ting information can be validated without stopping or re- 
starting the system. 55 

As can be easily understood from the above de- 
scription, according to the system of this embodiment, 
the user can easily change initial setting information as- 




sociated with the camera layout and the map to be used. 
In this case, the operability can be improved using a user 
interface which is easily understood. 

Any changed result of the initial setting information 
can be automatically reflected in the display state of 
each camera control client without stopping the system. 

The present invention is not limited to the above em- 
bodiments and various changes and modifications can 
be made within the spirit and scope of the present in- 
vention. Therefore, to apprise the public of the scope of 
the present invention, the following claims are made. 



Claims 

1. A controller for controlling an image input operation, 
characterized by comprising: 

image input means including at least one exter- 
nally controllable input unit (10); 
selection means (32) for selecting one of the 
input units, and receiving an image input from 
the selected input unit: 

image display means (28, 44, 271, 344, 84) for 
displaying the image input from the input unit 
selected by said selection means: 
map display means (28, 40, 340, 80) for dis- 
playing a map indicating a target image input 
region of said image input means, and display- 
ing, on the map, each of the input units as a 
predetermined symbol in correspondence with 
a position of the input unit: 
operation means (30, 4503, 278, 86) for oper- 
ating the symbol on a display screen: and 
control means (22, 12) for controlling the input 
unit corresponding to the operated symbol in 
accordance with an operation result of the sym- 
bol by said operation means. 

2. The controller according to claim 1, wherein said 
control means controls a pan angle, tilt angle, zoom 
ratio, and focal length of the input unit. 

3. The controller according to claim 1, wherein said 
map display means displays the symbol of the 
selected input un it to be identifiable from the symbol 
of the non-selected input unit. 

4. The controller according to claim 2, wherein when 
said operation means changes a direction of the 
symbol, the pan angle of the input unit is controlled 
by said control means in correspondence with the 
direction of the symbol. 

5. The controller according to claim 4, wherein said 
operation means comprises coordinate indication 
means for indicating a desired coordinate position 
on the display screen of said map display means 
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and determines a direction connecting the symbol 
corresponding to the selected input unit and a 
desired point indicated by said coordinate indication 
means as a changed direction of the symbol and 
said map display means displays the changed s 
direction using a straight line. 

6. The controller according to claim 2, wherein when 
said operation means changes the tilt angle of the 
input unit corresponding to the symbol, the tilt angle io 
of the input unit is controlled by said control means. 



7. The controller according to claim 6 : wherein said 
operation means comprises coordinate indication 
means for indicating a desired coordinate position is 
on the display screen of said map display means 
and determines the changed tilt angle of the input 
unit corresponding to the symbol in correspond- 
ence with the position of a point indicated by said 
coordinate indication means with respect to a posi- 20 
tion of the symbol corresponding to the selected 
input unit. 

8. The controller according to claim 2, wherein when 
said operation means changes the zoom ratio of the 25 
input unit corresponding to the symbol, the zoom 
ratio of the input unit is controlled by said control 
means. 

9. The controller according to claim 8, wherein said 30 
operation means comprises coordinate indication 
means for indicating a desired coordinate position 

on the display screen of said map display means, 
said coordinate indication means designates an 
angle defined between two half lines having the - 35 
symbol corresponding to the selected input unit as 
a central line, and the changed zoom ratio of the 
input unit corresponding to the symbol is deter- 
mined in correspondence with the designated 
angle. ■ 40 

10. The controller according to claim 2, wherein when 
said operation means changes the focal length of 
the input unit corresponding to the symbol, the focal 
length of the input unit is controlled by said control 

means. 



among a mode for changing the focal length of the 
input unit, a mode for changing the tilt angle of the 
input unit, and a mode for changing the zoom ratio 
of the input unit, and allows a desired operation in 
the selected mode. 

13. The controller according to claim 1, wherein said 
selection means selects an input unit correspond- 
ing to the symbol closest to a point designated on 
the map. 

14. The controller according to claim 2 : further compris- 
ing state display means for displaying a state of the 
input unit selected by said selection means. 

15. The controller according to claim 14, wherein said 
state display means displays the position, pan 
angle, tilt angle, and zoom ratio of the selected input 
unit. 

16. The controller according to claim 2, wherein said 
map display means displays a state of each of the 
input units. 

17. The controller according to claim 16, wherein said 
map display means displays a maximum field angle 
and a maximum pan angle of each of the input units 
using a predetermined pattern having the symbol 
corresponding to the input unit as a center. 

18. The controller according to claim 17, wherein the 
predetermined pattern is a fan shape having the 
symbol as the center. 

19. The controller according to claim 1, further compris- 
ing arrangement operation means for changing the 
map display by said map display means in corre- 
spondence with a state of an arrangement of the 
controller. 

20. The controller according to claim 19, wherein said 
arrangement operation means performs addition, 
deletion, and a change of position of the symbols 
corresponding to the input units in correspondence 
with the input units included in said image input 
means. 



11. The controller according to claim 10, wherein said 
operation means comprises coordinate indication 
means for indicating a desired coordinate position 
on the display screen of said map display means 
and determines a distance from the symbol corre- 
sponding to the selected input unit to a point indi- 
cated by said coordinate indication means as the 
changed focal length. 

12. The controller according to claim 2, wherein said 
operation means switches an operation mode 



21. The controller according to claim 1, further compris- 
ing connection means (36) for interconnecting said 

50 controllers. 

22. A control system for controlling an image input 
device (210, 241) connected to a network, charac- 
terized by comprising: 



55 



a client apparatus (243) which is connected to 
the network, requests use of a desired image 
input device, and controls the image input 
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device to receive an image when said client 
apparatus is connected to the image input 
device: and 

a management apparatus (245) for managing 
a connection state between said client appara- 5 
tus and the image input device, 
wherein upon receiving a request from said cli- 
ent apparatus, said management apparatus 
checks if a predetermined condition is satisfied, 
and if it is determined that the condition is sat- f 0 
isfied, said management apparatus permits 
said client apparatus to use the image input 
device. 

23. The system according to claim 22, wherein said >5 
management apparatus comprises storage means 
(250, 251 ) for storing a use state of the image input 
device, and a permission state which determines 

the client apparatus that can use the image input 
device, and 20 

when said management apparatus determines 
on the basis of the use state and the permission 
state stored in said storage means that the 
image input device requested by said client 25 
apparatus is not being used, and the permis- 
sion state allows said client apparatus to use 
the image input device, said management 
apparatus permits said client apparatus to use 
the image input device. 30 

24. The system according to claim 23, wherein said cli- 
ent apparatus comprises change request means for 
generating a change request for changing the per- 
mission state to said management apparatus, and 35 
said management apparatus changes the permis- 
sion state in correspondence with the change 
request. 

25. The system according to claim 23, wherein said cli- -to 
ent apparatus further comprises display means for 
displaying the permission state, and operation 
means for operating the permission state displayed 

by said display means, and said management 
apparatus changes the permission state stored in 
said storage means in correspondence with an 
operation state of said operation means. 

26. The system according to claim 22, wherein said 
image input device comprises a camera, and said 50 
client apparatus comprises control means for con- 
trolling a zoom ratio of the camera connected to said 
client apparatus. 

27. The system according to claim 26, wherein said cli- 55 
ent apparatus further comprises means for control- 
ling pan and tilt angles of the camera connected to 
said client apparatus. 



28. The system according to claim 23, wherein when 
said management apparatus sets the use state of 
the image input device connected in correspond- 
ence with the request from said client apparatus to 
be in use, and receives a request indicating end of 
use of the image input device from said client appa- 
ratus, said management apparatus sets the use 
state to be not in use. 

29. A camera controller characterized by comprising: 

at least one externally controllable camera 
(10); 

selection means (32) for selecting one of the 
cameras and receiving an image input from the 
selected camera: 

image display means (28, 44, 271 , 344, 84) for 
displaying the image input from the camera 
selected by said selection means: 
map display means (28, 40, 340, 80) for dis- 
playing a map of a region where the cameras 
are disposed, and displaying, on the map, each 
of the cameras as a predetermined symbol in 
correspondence with a position of the camera; 
operation means (30, 4503, 278, 86) for oper- 
ating the symbol on a display screen: and 
control means (22, 12) for controlling the cam- 
era corresponding to the operated symbol in 
accordance with an operation result of the sym- 
bol. 

30. The controller according to claim 29, wherein said 
control means controls a pan angle, tilt angle, zoom 
ratio, and focal length of the camera. 

31. The controller according to claim 29, wherein said 
map display means displays, on the map. a maxi- 
mum field angte and a maximum pan angle of each 
of the cameras using a fan shape having the symbol 
corresponding to the camera as a center. 

32. The controller according to claim 29, further com- 
prising means for maintaining the symbol corre- 
sponding to the camera on the map displayed by 
said map display means in correspondence with a 
state of an arrangement of said controller. 

33. A camera control method for controlling a remote 
camera, characterized by comprising: 

the display step (S1 - S3) of displaying a map, 

and displaying symbols of cameras on the map; 

the selection step (S6) of selecting a desired 

symbol from the symbols; 

the step (S7) of displaying an image input from 

the camera corresponding to the symbol 

selected in the selection step: and 

the change step of changing a state including 
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a pan angle of the camera selected in the selec- 
tion step. 

34. The method according to claim 33 ; further compris- 
ing, before the change step, the step (S10) of set- s 
ting an operation mode, and wherein the change 
step includes the step of changing one of a focal 
length, a zoom ratio, and a tilt angle in correspond- 
ence with the operation mode. 

10 

35. The method according to claim 33 ; wherein the 
change step includes the step of changing a state 
of the camera in correspondence with an operation 
of the symbol of the camera by coordinate input 
means. is 

36. The method according to claim 33, wherein the 
symbol selected in the selection step is displayed 
together with an auxiliary line used for operating a 
state of the camera corresponding to the symbol, 20 
and the state is changed by operating the auxiliary 
line by coordinate input means. 

37. The method according to claim 36, wherein the aux- 
iliary line includes zoom lines representing a field 2s 
angle and a tilt line indicating a tilt angle. 

38. The method according to claim 33, wherein a focal 
length and the pan angle are set upon selection of 

the symbol in the selection step. 30 

39. The method according to claim 33, wherein the dis- 
play step includes the step of displaying the symbol 
of each of the cameras in correspondence with con- 
trol characteristics of the camera corresponding to 35 
the symbol. 

40. The method according to claim 39, wherein the dis- 
play step includes the step of displaying the symbol 

of each of the cameras together with a maximum 40 
pan angle and a current field angle of the camera 
corresponding to the symbol if the control charac- 
teristics of the camera allow rotation and zoom 
operations, and displaying the symbol of each of the 
cameras together with the current field angle if the *s 
control characteristics of the camera do not allow 
rotation and zoom operations. 

41. A camera control method for controlling a remote 
camera, characterized by comprising: so 

the step of reading an initial setting state: 
the display step (S5102) of displaying a map 
and displaying symbols of cameras on the map 
on the basis of the initial setting state: ss 
the operation step (S5104 - S5121)of perform- 
ing operations including addition, deletion, 
change of position, and change of direction of 
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the symbol by operating the symbol using coor- 
dinate indication means: and 
the step of storing the symbol operated in the 
operation step as the initial setting state. 

42. The method according to claim 41, wherein the 
addition of the symbol in the operation step is 
attained by a dragging operation from a predeter- 
mined position as a start point on a screen dis- 
played in the display step using the coordinate indi- 
cation means. 

43. The method according to claim 41, wherein the 
deletion of the symbol in the operation step is 
attained by dragging the symbol on a screen dis- 
played in the display step to a predetermined posi- 
tion by the coordinate indication means. 

44. The method according to claim 41, wherein the 
change of position of the symbol in the operation 
step is attained by dragging the symbol on a screen 
displayed in the display step to a desired position 
by the coordinate indication means. 

45. The method according to claim 41, wherein the 
change of direction of the symbol in the operation 
step is attained by displaying, as a line, the direction 
of the symbol on a screen displayed in the display 
step, and dragging the displayed line of the direction 
to a desired direction by the coordinate indication 
means. 

46. The method according to claim 41 , further compris- 
ing the registration step (S37) of registering a new 
map. 

47. The method according to claim 46, further compris- 
ing the step (S40) of displaying the new map added 
in the registration step. 

48. The method according to claim 41 , further compris- 
ing the step (S44) of deleting the map. 

49. A camera management method for managing an 
access to a remote camera, characterized by com- 
prising: 

the step (S261) of identifying a request desti- 
nation apparatus on the basis of an access 
request to the camera: 

the first discrimination step (S263) of discrimi- 
nating if an access source of the access 
request is permitted to access the camera of an 
access destination; 

the second discrimination step (S264) of dis- 
criminating if the camera corresponding to the 
access request is in use when it is determined 
in the first discrimination step that the access 
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source is permitted to access the camera: 
the step (S265, S266) of making an access to 
the camera when the camera is not in use: 
the request step of issuing a change request of 
a condition for permitting an access in the first s 
discrimination step: and 
the step of changing a table, which is looked up 
in the first discrimination step, and registers 
permission or non-permission of access 
requests of access request source appara- *o 
tuses in units of cameras, in correspondence 
with the change request. 

50. A camera management method for managing an 
access to a remote camera, characterized by com- 1$ 
prising: 

the step (S261) of identifying a request desti- 
nation apparatus on the basis of an access 
request to the camera: 

the discrimination step (S263) of discriminat- 
ing, with reference to a table, which registers 
permission or non-permission of access 
requests of access request source appara- 
tuses in units of cameras, if an access source 
of the access request is permitted to access the 
camera of an access destination: 
the step (S281 ) of receiving a change request 
of the table, and identifying a request source of 
the change request; and 
the step (S282) of changing permission or non- 
permission of the access in the table corre- 
sponding to the request source of the change 
request in correspondence with the change 
request. 

51. A camera control system comprising a display for 
displaying the locations and operative conditions of 
a plurality of cameras, means for selecting an indi- 
vidual camera so the scene viewed by the camera *o 
is also displayed by the display means, and means 

for controlling each selected camera. 
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FIG. 19 

typedef struct camera_in { 

double tilt_angle ; 

double pan_angle ; 

int zoom ; 
} camera_in ; 

typedef struct func_out { 

int ret ; 
} func_out ; 

CLIENT *camera_open (char *host) ; 
void *camera_close (CLIENT *cl) ; 

func_out *camera_pan_pos_l(camera_in *, CLIENT *cl) ; 
func_out *camera_tilt_pos_l(camera_in *, CLIENT *cl) ; 
func_out *camera_zoom_pos_l(camera_in *, CLIENT *cl) 



FIG. 20 

typedef struct host_name { 

char name [MAXNAME] ; 
} host_name ; 

void append_camera_list_l(host_name *, CLIENT *cl) ; 
void delete_camera_list_l(host_name *, CLIENT *cl) ; 
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FIG. 24 

typedef struct access_in { 

char target_name [MAXNAME] ; 

char user_name [MAXNAME] ; 
} access_in ; 

func_out *access_begin_l(access_in *,CLIENT *cl) ; 
func_out *access_end_l((access_in *,CLIENT *cl) ; 
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FIG. 27 

typedef struct change_in { 

char target_name [MAXNAME] ; 

int access_mode ; 
} change_Jn ; 

func_out *change_access_mode_l(change_in * .CLIENT *cl) ; 
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FIG. 31 



(camera CONTROL j 



S311 



ZOOM 




SET PAN ANGLE BASED ON 
PARAMETER OF 'camerajn* TYPE, 
AND EXECUTE FUNCTION 
"camera _pan_pos_1 " 



S313 



S314 



SET ZOOM RATIO BASED ON 
PARAMETER OF 'camerajn* TYPE, 
AND EXECUTE FUNCTION 
"camera_zoom_pos_1 " 



SET TILT ANGLE BASED ON 
PARAMETER OF 'camerajn' TYPE, 
AND EXECUTE FUNCTION 
*cameraJilt_pos_1 ' 



S315 



S316 

_L 




ERROR PROCESSING 



c 



END 



3 



52 



EP 0 715 453 A2 



FIG. 32 
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ABSTRACT : PURPOSE: To make the operations of plural cameras easy to understand by 

image-displaying the arrangement of cameras and their positions by the use of maps and 
camera icons. 

CONSTITUTION: The map of an office in which the camera that is a controlled system is 
placed is displayed on a map window 40, and the camera icons 42-1 to 42-7 are 
superimposed on the installing place of each camera. The output video of a designated 
camera is displayed on a video window 44. The number and control value of one selected 
camera, etc., are displayed on a camera control window 46. The camera that is the 
controlled system is designated by the operation to select the camera icon. A focusing 
position is designated by a point instruction. A panning angle is designated by a change 
operation for a selected camera icon. Zooming and tilting angles are designated by the 
operations of a zoom line and a tilt line displayed on the selected camera icon, 
respectively. The panning, tilting, zooming and focusing of a corresponding camera can be 
controlled corresponding to the operation for each camera icon. 
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